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ABSTRACT 

This document is designed for use as a resource and 
reference guide for Air Force instructional managers who are 
considering the adoption or expansion of computer-assisted 
instruction (CAI) at some future time, and also ai a decision aid for 
an instructional manager currently involved in the CAI decision 
process. The contents are intended to be helpful where CAI systems 
are already available to the trainers, as well as in those cases in 
which the adoption of CAI requires new system acquisition. The 
handbook is divided into five sections: (1) Introduction and History 
of CAI; (2) Understanding CAI; (3) Critical Factors for Adopting CAI; 
(4) Decision Aids for Considering the Adoption of CAI; and (5) 
Resources. The section on decision aids includes worksheets for use 
in evaluating the need for CAI, identifying configurations most 
closely matched to instructional needs and practices, and estimating 
the feasibility of initiating CAI implementation. Resources listed 
include a glossary, an extensive bibliography, and lists of related 
associations and periodicals. (THC) 



**************************************************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
*********************************************************************** 



AFHRL-TR-84-46 




UA. MPMTMMir Of WNICATNM 

WATK>*A1 mtmTOTl Of eoocatxm* 
fOUCATKMAl MSOUftOS 

^Tt* doom** tat tan wpmfcjQ* * 
ricoiatd from tt* ptreon or nrginiiiajQn 

U Minor change havt teen made to 
reproof tw quefctv 

* h*nti or view or op*rnon« tut** m tfw docu- 
ment 00 rtol r woea e an fy npwum officii fim 
portion or polcv. 



COMPUTER-ASSISTED INSTRUCTION: DECISION HANDBOOK 



Sue Keaner-Rlchardson 
Joseph P. Lamos 
Anita S. West 



Social SystMS Rasaarch and Evaluation Division 
Dtnvtf Rasaarch Instltutt 

Unl varsity of Danvtr 
Danvar, Colorado 80208 



TRAINING SYSTEMS DIVISION 
Lowry Air Force Base, Colorado 80230-5000 




April 1985 

Final Raport for PaMod Nay 1982 - Dscaabar 1982 



Approvad for public r«l me: distribution unl 1.1 tad. 



AIR FORCE SYSTEMS COMMAND 

BROOKS AIR FORCE BASE, TEXAS 78235-5000 



NOTICE 



Mlian 6overne*nt drawings, specifications, or other data ara ueed for any 
purpose other thaa la eoaaactloa with a definitely wovernawnt-related 
procurement, tha United Statat fioverroeent Incurs no responsibility or any 
obligation whatsoever. Tha fact that tha fiovernwent My have formulated or 
In any way supplied tha said drawlnge, specifications, or othar data, la 
not to bo ragardad by Implication, or otharwlsa In any Mnnar conttruad, aa 
llceaelng tha holdar, or any othar paraon or corporation; or aa convoying 
any righte or parnlaalon to manufacture, use, or tail any patantad 
Invention that may In any way ba ralatad tharato. 

Tha Public Affairs Offlca haa reviewed thla raport, and It Is ralaaaablo to 
tha National Technical Information Service, whara It will ba available to 
the general public. Including foreign nationals. 

Thla report haa been reviewed and la approved for publication. 



JERRY WALKER 
Contract Monitor 



JOSfPH Y. YASUTAKE. Technical Advlfor 
Training Systems Division 



ANTHONY F. BRONZO, JR., Colonel, USAF 
CoMandar 



VBCfBSSffftf 



SECURITY CLASSIFICATION OF THtt PA08 



RETORT DOCUMENTATION PAGE 



|«* RSfOUT SECURITY CLASSIFICATION 



1B» RESTRICTIVE MA UK I MOS 



, SICUHITY CLASSIFICATION AUTHORITY 



3. DISTRIBUTION/AVAILABILITY OF REPORT 

ApprcvH for public rslsssss dlftrlbwtlon imllBltsd* 



OECLASSIFICATION/OOINNaRAO.NO SCHEDULE 



[4. PERFORMtNQ ORGANIZATION REPORT NUMBS R(S) 



ft. MONITORING ORGANIZATION REPORT NUMIIR(S) 



|s* name of performing organization 
Dssvsr Isssarctt XsstltBts 
Htuvtrftity of Osmr 



to. OFF ICC SYMBOL 



7m. NAM! OF MONITORING ORGANIZATION 

Trsfslftf Systsss Division 

Air Fcrct Hum* issssrcss Ufccntory 



[Sc. ADDRESS (City. SUM md ZIP Cod*) 

&ssvsr, Colorado 80208 



7tK AOOH1SS (City, md ZIP Cod*) 

Lowry Air Forct list, Colorado 80230-5000 



It NAM* OF FUND* NO/SPONSOR J NO 
ORGANIZATION 

Air Fores Hums Rssourcsi Laboratory 



Sb, OFFICE SYMBOL 
(lf***Ue*M*l 

HQ AFNKL 



S. PROCUREMENT INSTRUMENT IDENTIFICATION NUMBER 

F33818-81-C-OOQ7 



( Be ADDRESS (City. *U* m4 ZIP Cod*) 

•rooks A1r Fores lass, Tsxss 78235-M01 



10, SOURCE OF FUNDING NOS. 



[It. TITLE JlmtUS* Security Omm4fi*mtio*> 

CMputsr-Asslstsd Instruction: 



Dsclslos Handbook 



PROGRAM 


PROJECT 


TASK 


WORK UNIT 1 


ELEMENT NO. 


NO, 


NO. 


NO. I 


♦220SF 


1121 


09 


IS 1 



| IS, PERSONAL AUTHOR (SI 

KsgBBrjlchardsoSj Sss; Ls«os» Jostph v*st, Anita $♦ 



TYPE OF REPORT 

Flna? 



13* TIME COVERED J 14. DATE OF REPORT (Yr., Mc, Omy) 

from May 82 to Dsc 82 I April If 88 



1S. FAGS COUNT 

2S2 



IB* SUFPLSMBNTARY NOTATION 



LIT, 



COBATI CODES 



1 FlSl.0 


anoup 


sua. an. 


1 OS 


09 











1& SUBJf CT TiRMt (Continue oh ntmrm If MCfMvy end identity by block number) 

coaputar-asslstad instruction coaputar-basad altarnatlvas 
coaputar-asslstad training coaputar-basad training 



Tdli Handbook hat baan writ tan for two appllcatlot : first, aa a rasoorca and rafaranc* gulda for Air Fore* 
Instractloaal awnafara who ara conaldarlnn tka adoption or axpaaslon of conputar-asslstad Inatractlon (CAI) at 
aoM future tlaa and, aaeond, aa a daclslon aid for an Instructional aanagnr currant ly Involvad In tba CAI 
daclslon procasa. Tba ass of tba handbook la approprlata for consldarlftf tba laplanaatatlon of CAI In a now 
coaraa or in an nxlstlna coarr . its contanta ara daslfnad to ba balpfal vbara CAI aystam ara alraady aval labia 
to tba tralnars, as wall aa 1a tbosa casas In which tba adoption of CAI raq«1rsa na» systaan acquisition. A 
alfnlflcant wount of kaowladfa about Inatractlon and about Air Forca Instructional procaduras and alnlawa 
axpnrlaaca with CAI ara aaauawd. Tba workbook portion of tka handbook prasants spaclflc tools, in tho form of 
workshaata. for avaluatlaj tba naad for CAI* for idoatlfylnf configurations awst elaaaly mtcbad to Instractloaal 
Mfda aad practlcts. and for ast matins tka feasibility of Initiating CAS laplaawatatlon. 



[M DUTBiaUTION/AVAICABIUTY OF ASOTRACT 

luNCLASSl PIED/UN LIMITS O IS SAMS AO «FT. □ OTIC UHN □ 



31. ABSTRACT atCURITV CLASSIFICATION 



NAMf on «ts#o**iai.i individual 
Merli 



8W/ln^Kflea 
DO FORM 1473. 83 APR 

ERIC 



SSfc TELEPHONE NUMBER 

(Im*4ud* An* Cad*) 

(f 12) IH-J877 



SOITION OP 1 JAN 73 IB OBSOLETE. 

BEST COPY AVAILABLE 4 



33c. OFF ICS aVMBOL 

AFHRl/TSR 
Hnclanalflad 



MCUfltTV CLASSIFICATION OF TNI* FAOi 



SUMMARY 



The Computer-Assisted Instruction* Decision Handbook has been written 
for use as a resource and reference guide for Air Force instructional managers 
wno are considering the adoption or expansion of computer-assisted Instruction 
(CAJ) at some future time and also as a decision aid for an instructional manager 
currently Involved in the CAI decision process. The use of the handbook is 
appropriate for considering the implementation of CAI in a new course or in an 
existing course. Its contents are designed to be helpful where CAI systems are 
already available to the trainers, as well as in those cases in which the adoption of 
CAI require! new system acquisition. Field tests of the handbook were conducted 
at Sheppard and Keesier Air Force Bases late in 1983. The tests included a 
formative evaluation to improve the format and presentation of the handbook and 
an implementation analysis in order to estimate the resoirces required for 
appropriate application of the manual as a decision tool. The workbook portion of 
the handbook presents specific tools, in the form of worksheets, for evaluating the 
need for CAI, for identifying configurations most closely matched to instructional 
needs and practices, and for estimating the feasibility of initiating CAI 
implementation. ° 
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L INTRODUCTION AND HISTORY OF CAI 



A. The Purpose of ttte Handbook 



This handbook has been designed to provide information concerning the 
use of computer-assisted instruction {CAO, tradeoffs associated with the adoption 
of CAI, and procedural decision aids for selecting appropriate levels of CAL In 
more specific terms, the handbook has the following two objectives* 

1. To provide a general orientation to the nature of CAI 
and the applications that are possible with this form of 
instruction. 

2. To provide Air Force training personnel who have to 
make decisions concerning the adoption of CAI with 
specific information and decision aids to help them 
specify the requirements for this instructional 
technology and to propose appropriate levels of its 
application. 

The handbook should be especially helpful to those individuals who have 
little prior experience with CAL For these individuals, as well as others, this 
handbook is designed to help its users comprehend the range of possibilities 
available in CAL It is also designed to help the user apply CAI in a judidous 
manner as part of the overall instructional design and development of either an 
existing or new training course. 

For the training managers or developers who have prior knowledge of 
and/or experience with CAI, this handbook provides a ready source of specific 
information necessary for the development of training plans and the 
determination of resources and data to secure a reasonable application of CAI 
within their training operations. 

There has been no intention in the design of this handbook, however, to 
make it a single source of information on the full breadth of issues involved in 
applying CAL It is important to distinguish the difference between the process 
leading to the decision to adopt a new technology and the processes necessary to 
implement the technology successfully. This handbo ok is designed tc assist the 
user with the adoption decision process, and it discusses implementation issues 
only as they have relevance to that decision. 



B. Organization of the Handbook 



The handbook is arranged into five sections. 

• Section I, Introduction and History of CAI, states the 
purpose of the handbook, gives a definition of CAI, delimits 
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the context in which CAI is treated, and in an optional 
section, pwiues a brief history of CAI in Air Force 
Technical Training. 

e Section II, Understanding CAI, provides a broad overview 
of the critical issues involved in making a decision about 
CAI. This section is meant to give the necessary 
background for understanding more fully the discussion of 
specific factors that will be deta. ed in Section in. 

e Section in, Critical Factors for Adopting CAI, is a body of 
reference information on many of the major factors that 
should be considered in order to come to a preliminary 
decision about the use of CAI. These factors have been 
derived from the experience base of the last 2 decades of 
work In CAI. Section III is arranged so that it can be read 
straight through and also provides easy access to a 
particular issue when the decision aids in Section IV are 
used. 

• Section IV, Decision Aids, provides a series of questions 
and flow charts to help in organizing the planning and 
decision process. These aids are provided in order to allow 
a reasonable assessment of the need for and the impact of 
using CAI, as well as providing a realistic assessment of 
the resources and activities required for a successful 
implementation. 

a Finally, Section V, Resources, provides readily accessible 
information io use as a resource to seek further 
information beyond that which is provided in the handbook. 
The resources include a glossary of terms and acronyms. 

Two general precautions apply when the handbook is being used. First, 
CAI is frequently and, for many applications, most efficiently utilized within a 
computer-based training system that includes management of student progress, 
training resources, testing, and instructional materials development and 
maintenance. (The treatment here is focused entirely on the interactive 
instructional mode called CAI and does not emphasize other important aspects of 
computer-based instruction.) Second, even with this limitation, CAI is still a 
complex topic; CAI itself and the decision to use it cannot be reduced to a set of 
simple truths. It is strongly urged that the information in this handbook be used 
as guidance tempered by the realities of a particular context and an appreciation 
for what is involved when introducing any kind of change into an organization. 

As has been mentioned and will be again, CAI is not a panacea for all 
instructional or training problems. CAI is a powerful instructional tool— one that 
can be used to great advantage, as well as one that, if misused, can produce 
greater problems. The lessons of the past clearly point to the fact that the use of 
CAI requires commitment. It is hoped that this handbook will provide the 
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necessary insight to the scope of the issues involved and the degree of 
commitment necessary ki order to tales full advantage of this powerful 
ins ir"x.itonai vecnnotogy. 



C. A Brief History of CAI in Air Force Technical Training (optional) 



The Air Force, along with the rest of the services In the Department of 
Defense, has been a pioneer in the research and development of CAI capabilities. 
Significant implementation projects for CAI have also occurred. Most notable of 
the CAI implementations that have occurred to date in the Air Force have been 
projects at the Chanute and Sheppard Technical Training Centers involving the 
PLATO computer-based instruction (CBD system and the Advanced Instructional 
System (AIS) effort at Lowry AFB. 



1. PLATO 

PLATO (Programmed Logic for Automated Teaching Operations) was 
originally developed at the University of Illinois under the auspices of the 
National Science Foundation and the Department of Defense (DoD). The original 
research concepts for PLATO actually began in the late 1950s and resulted in 
several early versions; however, it was the version known as PLATO IV that 
ultimately became operational on a large scale at the University of Illinois. 
Initially, PLATO was purely a CAI system. In its present form, PLATO is now a 
commercially available CBI system which includes computer-managed Instruction 
(CMl). PLATO is both the oldest and largest CBI system available. PLATO is 
primarily a centralized, time-shared system (these terms are more fully explained 
In Section m.D)j howevet, there is also a stand-alone delivery capability version 
called MicroPLATO. Through funding provided by the Defense Advanced 
Research Projects Agency (DARPA), a Tri-Service evaluation of PLATO was 
initiated at the Chanute Technical Training Center (CTTC) at Chanute AFB. The 
CTTC was chosen because of Its proximity to the University of Illinois. The 
evaluation project was conducted in three phases. The first phase lasted from 
July 1972 to June 1974 and involved extensive planning of the operational 
implementation and -he acquisition of equipment. This phase was long because 
PLATO was still very much an experimental system in 1972, and significant effort 
was needed to work out a variety of logistical and technical problems. 

Phase II of the PLATO evaluation project began in June 1979 and lasted 
until January 1976. Phase II was devoted to the development of CAI materials 
that became part of the new curriculum for the Special Purpose Vehicle 
Repairman courses at Chanute. This phase also included the validation of the 
developed material and their formal evaluation as to their capability to conduct 
instruction effectively. 

Phase III of the PLATO project overlapped Phase II, beginning in October 
1975 and conducing in September 1976. Phase ID consisted of a frits of seven 
tcperimental lessons to test the efficacy of CAL 
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The evaluation that was performed on the Chanute PLATO project was 
extensive and Is fully reported by Dalimen, DeLeo, Main, and Gillman (1977). 
Summarized below are a lew highlights of the findings of this report. 

a. Instructional Effectiveness. Results indicated that PLATO-based 
instruction was as effective as the regular course of instruction and resulted in a 
28 percent reduction In training time. As compared to programmed texts and 
workbooks, students were more attentive and stayed on task. The attentiveness 
to PLATO materials was comparable to that which students give to hands-on 
laboratory activities. 

b. Cost Effectiveness. With the mainframe computer technology of the 
mid-19704, the PLATO-based course was not as cost effective as a course based 
on programmed texts and conventional printed) testing. The figures provided 
showed that the operational costs of the PLA r O-based course were $87,500 higher 
than the estimated costs associated with programmed texts and workbooks. 
However, cost-avoidance savings due to the total combination of instructional 
system development (ED) procedures, PLATO, and instructional material design 
was determined to be $180,000 a year. It was estimated that PLATO lessons were 
10 percent more efficient than equivalent programmed texts. 

c. Instructional Impact. Overall, the attitudes of students toward the 
PLATO-based instruction were more positive than the attitudes of their 
counterparts not using PLATO instruction. Initial positive attitudes of instructors 
toward PLATO declined over the period of the project and were attributable to 
dissatisfaction with a lesser direct role in the instructional process associated 
with PLATO. The PLATO project was able to operate within the existing Air 
Training Command regulations at the time; however, new and innovative training 
approaches potentially possible with PLATO were not attempted. 

d. Instructional Development. Instructional development was carried 
out under the guidelines of ISD. The results of the PLATO project at CTTC 
revealed that the traditional concept of instructor/author was inadequate to cope 
with the demands of CAI development on a large scale. The recommendations of 
the evaluators was that a team approach to CAI development be used in the 
future. 

e. Management. The PLATO-based instruction was managed under the 
administrative structure of group-pacing. Overall, the evaluators concluded that 
"drastic or unusual" management procedures were not required to manage PL A TO j 
however, there were strong implications that the ultimate effectiveness and 
efficiency of PLATO-based instruction require extensive preplanning and a 
flexible attitude toward adopting nontradltional methods of training management. 
This finding is similar to recommendations made in a recent evaluation of 
successful implementations of self-paced instruction in general as reported in 
McCombs, Back, and West (198*). 

In addition to the PLATO experience at CTTC, PLATO was also 
implemented and evaluated at Sheppard Technical Training Center, Texas, in the 
School of Health Care Sciences. The results of this implementation were reported 
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by Deignan, Seager, Kimball, and Horowitz (1980) and by Steinkerchner, Deignan, 
Waters, and DeLeo (1977). 

The results of the PLATO evaluation at Sheppard AFB pointed out the 
need for extensive preplanning activities to ensure that appropriate staff 
personnel are in place and that course instructional staff are trained prior to the 
implementation of CAI. 

The Sheppard evaluation also provided cost data that reflect the use of a 
mainframe CAI system in which recurring communication costs are involved. For 
1 full year (1975), a 20 -terminal system Incurred a cost of $50,000 for terminal 
leasing and $25,641 for communications back to the remotely located mainframe. 

Instructionally, the Sheppard evaluation revealed that CAI had a 
demonstrable and significant impact on both the quality and effectiveness of 
instruction. CAI Increased student performance as much m 18 percent over 
comparable areas of lecture-based instruction. CAI was at least 17 percent more 
efficient than programmed texts for low aptitude students; and for high aptitude 
students, time savings of 29 percent to 32 percent were achieved. 



2. AIS 

The Advanced Instructional System at Lowry Technical Training Center 
was undertaken by the Air Force to achieve two major goals: (a) to integrate a 
variety of known advanced instructional technologies in a system configuration 
that could support several operational training courses simultaneously and (ft) to 
provide a powerful test bed for implementing and evaluating new instructional 
technology. AIS started as a contracted effort in 1973 and ran as such to the end 
of 1977. Its development continued from 1977 to approximately the middle of 
1981, when the final portions of the original courses were no longer being 
supported by the research-funded AIS computer system. AIS is presently being 
used to support a variety of prototypic research and demonstration activities 
within the Air Force Systems Command as well as in operational commands such 
as the Tactical Air Command and the Strategic Air Command and in industrial 
applications. 

Because AIS was designed to integrate a variety of instructional 
technologies, it was configured as a CBI (i.e», both CAI and CMI) system, with an 
emphasis on CMI. For a great portion of the time in which the AIS project was in 
effect, the major mode o: instructional delivery was programmed texts. Toward 
the end of the project, a strong CAI capability was devc.'oped, and CAI materials 
were developed and implemented. The AIS is described by Lintz, Pennell, and 
Yasutake (1979; McManus (1979); and Montgomery and Judd (1979). 

The results of the AIS program showed that CAI lessons resulted in 
reduced lesson failure rates. Programmed text lessons had an average failure rate 
of 23 percent* whereas for the same lesson areas. CAI had a failure rate of only 6 
percent (Lewis, Lovelace,, Mahany, & Judd, 1980). In terms of efficiency, the CAI 
lessons in AIS averaged 11.2 percent less administration time than did similar 
lessons in a programmed text format. 
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An important aspect of the A IS experience wUh CAI is the fact that A IS 
CAI materials were developed using an authoring system (see Section IH.D.2). The 
use of an authoring system can be contrasted to the use of an authoring language 
for the development of CAI (see Section ILE and Section IU.D.2). The PLATO 
system as it was used in the earlier projects at Chanute AFB and Sheppard AFB 
used an authoring language. A recommendation that came out of both PLATO 
projects was that the development of CAI materials should be accomplished 
through the use of a development team consisting of both instructor* and CAI 
authors. In the A IS system, the creation of an authoring system was designed to 
simplify the CAI fithoring process such that instructors could be both subject- 
matter expert and author. Based on the A IS results, it is apparent that instructors 
can efficiently develop effective CAI materials, given the use of an effective 
authoring system which does not require computer programming expertise. The 
availability of CAI development tools such as authoring systems or authoring 
languages can help determine the amount of organizational Impact the use of CAI 
will have. 



3. Present CAI Activities 

Several CAI efforts are in progress or are in the planning stage. The 
following project summaries illustrate the general level of ongoing CAI activities 
within the Air Force. The listing is not meant to be exhaustive. 

ATS. This is the Advanced Training System. The purpose of this sytem 
is to provide organizations within Air Training Command (ATC) with a broad CAI 
and CMI capability to accomplish six training delivery tasks* information 
presentation, demonstration, drill-and-practice, evaluation, feedback, and 
remediation* Additionally, management capabilities will be provided to allow the 
appropriate and timely match of students, instructors, equipment, and 
instructional material resources. The management function will also provide the 
ability to track student progress and allow the evaluation of the adequacy of the 
instructional process. 

Status. The test and operational phase is FY 198*. It is expected to 
become operational in FY 1985. 

BLTMS. This is the Base Level Training Management System. The 
development of this system Is also being supported by ATC. The purpose of this 
system is to provide a computer-based data collection and management capability 
that provides an interface between ATC technical courses and the Advanced 
Personnel Data System (APDS). BLTMS will also provide for course management 
and course documentation. 

Status. BLTMS is an in- ho use effort of ATC. 

TRIM. This is the Time Related Instructional Management system. This 
system provides CAI for Undergraduate Pilot Training, plus management and 
scheduling support for training flight activities. 



Status. This system is operational at Goodf diow AFB, Texas. 

PLATO . CAI as provided by the PLATO system Is stitl being conducted 
at both Chanute AFB and Sheppard AFB. 

StatSe Ongoing 

CDTS. This is the Compter- Directed Training System which originated 
at Keener AFB in 196S. This C\l capability exists on the Honeywell H6000, 
Phase IV, base-level computer. The CAI is provided for the training of computer 
personnel (operators and programmers). Early 1970 experiments with CAI on the 
B-3500 demonstrated the effectiveness and efficiency of using a computer to 
provide on-the-job Base Lewi Military Personnel System (BLMP5) training using 
remole terminals. In early 1972, Hq USAF identified the World Wide Military 
Command and Control System (WWMCC5) as an area for similar training programs 
for computer operators, programmers, and system analysts. It was decided that a 
combination of resident Keesier courses and CAI lessons for use at operational 
WWMCCS sites would be used to satisfy user needs. The CDTS capability is 
available to data processing installations on an Air Force-wide basis. 

Status. Operational 

15 S. This is the Instructional Support System. This system is to provide 
a set of software modules for supporting CAI and CML The modularity will allow 
users to select just that level cl CAI or CMI functionality v/ltich they need, thus 
avoiding an overly complex system. In addition, the software modules are to be 
transportable; that is, designed to operate on a variety of hardware from 
microcomputers to large mainframe computers. The ISS is i follow-on effort 
derived from the AG demonstration system at Lowry AFB. The software will be 
written in Ada and targeted for TRIADS Library. 

Status. In planning and initial development by the Air Force Human 
Resources Laboratory , 



». Other DoD CAI Efforts 

All three services have conducted research and development (R&D) in 
CAI over the last 2 decades. The body of information available from this R&D is 
voluminous. Background information on CAI based on DoD work in the area is 
available from the Defense Technical Information Center (DTIC) anoVor the 
National Technical Information Service (NTS). Of interest are the following 
major efforts presently existing within the DoD community. 



TRIADS/ *^ This is a joint service effort that involves the planning and 
development of a family of hardware and software capabilities which have 
sufficient flexibility to support a large variety of CAI and CMI requirements. The 
TRIADS Joint Service Committee consists of representatives from the Army 
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Research Institute (AR0, Air Force Human Resources Laboratory (AFHRL), Navy 
Personnel Research and Development Center (NPRDC), and Naval Training 
Equipment Center (MTTC). 

The hardware for TRIADS is to feature modularity and interdevice 
compatibility. The software is to be based on the new DoD language Ada and is to 
be machine independent and user friendly. Five levels of capability are to be 
provided within the TRIADS concepts Level 0, Limited Function Portables} Level 
1, Single User Instructional Device; Level 2, Single User Workstation* Level 3, 
Multi-User Workstation} Level Artificial Intelligence Compatible Workstation; 
and Level 5, Multi-User Mainframe. The TRIADS also incorporates a software 
library of instructional support and development tools plus courseware in broadly 
applicable content areas. ISS and CBESS represent the type of software which 
will be included In the TRIADS Library. 

CBESS. This is the Computer-Based Educational Software System 
(CBESS). It involves the development of a software library based on the use of a 
common, machine-independent software language. The candidate languages being 
considered are Pascal, C, and Ada. The software for several existing Navy 
programs are to be converted into the chosen language. The following programs 
are to be converted: 

e C A SI MS: Computer-Assisted Instruction Study Manage- 
ment System 

e EEMT: Electronic Equipment Maintenance Trainer 

e The Computer-Based Tactical Memorization Training 
System 

e Language Skills Computer-Assisted Instruction 

TPSS. This acronym refers to a computer-based system of instruction 
and job performance aids developed for the Air Force Systems Command (AFSC). 
The Denver Research Institute has augmented vendor-supplied hardware and 
software to implement a "Training and Performance Support System" (TPSS) for 
Air Force personnel assigned to System Program Offices (SPOs). 

The system was designed for novice and less experienced acquisition 
managers and provides access to an individually tailored curriculum on an "as- 
required" basis. Each lesson topic is complemented by a task-oriented data base 
which provides job performance aids in the form of policy, lessons learned, 
procedures and technical background information. These aids are accessible from 
the work environments. 

An instructional model designed for adult learners is employed in TPSS 
and formative evaluation of the system concept and Implementation will begin at 
the Electronics Systems Division during October 1983, prior to deployment in 
other AFSC Divisions. 
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D. Com puter-A stilted Instruction In Perspective! A Definition 



The application of computer technology to the instructional process is by 
no means a recent development, although with the advent of lower-cost computer 
hardware, the feasibility and attractiveness of this technological application have 
increased rapidly. Earliest research applications occurred in the 1950s, followed 
by significant practical applications using large mainframe computers occurring in 
the mid and late 1960s. One such early application that was developed at the 
University of Illinois during the 1960s and has since evolved and matured into one 
of the major computer-based instructional systems is the PLATO system. Several 
computer-based instructional systems are now available and offer a wide range in 
both system cost and capabilities. Thus, the application of computers to the 
instructional process has a background of over 2 decades of research and 
application. 

A general historical background on computer applications to instruction 
is available from the literature listed in the bibliography (Section V.C). This 
literature provides a wide range of descriptive terminology and corresponding 
acronyms. However, the most often described application of computers to 
instruction is referred' to as computer-assisted instruction (CAD. It is this 
particular application and its variations that are the subjects of this handbook. 

Computer-assisted instruction is defined as follows: 

COMPUTER-ASSISTED INSTRUCTION (CAD IS THE USE OF 
THE COMMUNICATION AND STORAGE CAPABILITIES OF 
A COMPUTER TO PROVIDE THE DIRECT PRESENTATION 
OF INSTRUCTIONAL MATERIALS AND/OR PROVISION OF 
PRACTICE TO THE LEARNER* 



1. Variations in CAI 

The definitio given is general and does not reflect the range of specific 
instructional strategies or types of instruction that can be included under the 
umbrella of CAL A complete discussion of these specific strategies can be found 
in Section II of this handbook. Briefly, however, the range of CAI applications 
includes those which are conventionally found in most educational and 
instructional situations. These would include straight expository presentations 
typical of a lecture format or a textbook, as well as interrogative presentations 
typical of classroom discussions and informal quizzes. Additionally, CAI offers 
unique capabilities associated with the dynamic com muni cation and presentation 
qualities of the computer medium. It is these latter qualities which are of special 
value in the form of highly interactive tutorial- and simulation- type 
presentations. However, as in any complex human endeavor such as instruction, 
no single form or type of technological approach is universally applicable. As 
mentioned, the purpose of this handbook is to permit judicious judgments about 
the adequacy of CAI as an instructional technology arid method and not to 
represent CAI as a panacea for all instructional and/or organizational problems. 
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In addition to the terminology of CAI, other terminology and forms of 
computer applications will be encountered in the realm of instruction. Rather 
than CAI, the term computer-assisted learning (CAL) may be found} this term has 
evolved primarily from work in the United Kingdom. As will be discussed shortly, 
early CAI work was heavily influenced by research and applications of 
programmed instruction and its primary medium— the programmed text. 
Programmed instruction has been primarily based on a psychological theory of 
learning called behaviorism and has found extensive use in areas of instruction 
concerned with training. Training, as contrasted to education, is typically 
characterized by well-defined tasks and specific, definable outcomes. Education, 
on the other hand, is more often characterized by general goals and outcomes 
geared to prepare an individual for a variety of potential activities. Generally 
speaking, CAL is a term which has corne to be preferred by certain educators to 
reflect an emphasis on the general learning process associated with education and 
to reflect also an emphasis or concern for the activities of the learner. This 
contrast can be represented in non computer terms as the difference between 
learner-based activities versus instructor- or teacher-based activities. 

Another term that will be used more in the future is intelligent 
computer-assisted instruction OCAI). I CAI is a form of CAI which applies 
principles from the field of artificial intelligence to achieve a lesson structure 
which permits a greater degree of individualization. Additional information on 
ICAI is provided in Section n D.6. The development of I CAI reflects a 
characteristic of the development of most new technology— its initial widespread 
application tends to be evolutionary As a consequence, its initial use tended to 
reflect the application of concepts from earlier technologies that preceded it, just 
as early television shows reflected the techniques of the live theatre or of radio 
broadcasting before people became experienced enough to capitalize on the 
unique features of the new TV technology. As is frequently the case with 
pioneers, early workers in CAI had typically high expectations for the new 
technology. However, these expect? tions often exceeded the capabilities of the 
computer hardware and software available. As both hardware and software 
capabilities have improved, the original high expectations are becoming 
achievable. 

In CAI, the original expectation was that the computer would serve as an 
exemplary teacher, carrying on a rich dialogue with the student. In fact, 
instructional programs implemented in the early years of CAI were often 
automated versions of printed text materials, such as programmed texts, or film- 
based materials, such as instructional filmstrips. As more experience was gained 
and computer hardware and software capabilities decreased in cost, applications 
of CAI have improved in their ability to take advantage of the features of the 
computer communications medium* ICAI is a term that is now applied to CAI 
applications which do in fact represent a quality dialogue between the learner and 
the computer and which meet the original high expectations of the pioneers in 
CAI. A characteristic of ICAI is that the dialogue or the flow of the lesson is not 
predetermined. Unlike typical CAI tutorials in which the author anticipates 
possible student responses and provides a certain set sequence of instruction for 
each response, an ICAI lesson is characterized by its ability to adapt the lesson 
flow on the basis of its own decision model rather than a limited set of 
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predetermined possibilities. Such a capability has been achieved by applying 
knowledge from the area of research known as artificial intelligence. 

The discussion so far emphasizes the perspective that the term CAI is 
broad in meaning. Those who use this handbook to help understand how and where 
to apply CAI, should keep In mind the wide variations of CAI that are now possible 
and those that will soon become possible. CAI is really a continuum of 
applications ranging from the simple presentation of information to the rich 
dialogue capabilities of ICA1. When vendors, consultants, and other professionals 
provide requested information, these people must carefully specify the CAI 
application to which they are referring. 

Finally, the computer is increasingly being used in combination with 
other forms of technology. Thus, it is likely that reference will be made to such 
terms as mmpyfsi ■oststod video instruction (CAV0--the application of computer 
technology with either video disc or video tape technology, and computer-assisted 
instructional simulation (CAIS)-- the combination of CAI with the simulation 
technology of a particular environment. As the number of applications of CAI 
increase, further differentiation can be expected in the terminology used. 



2. CAI and Other Instructional Technology 

CAI refers strictly to the delivery of instruction and/or provision for 
practice. CAI in all of its present and future variations Is simply another medium 
of instructional delivery. Other media of instructional delivery induce the human 
instructor, student peers, television, the various film-based media, etc. To decide 
on the adoption of CAI for an entire course or even for any part of a course 
requires balancing the costs and benefits of CAI against these other forms of 
delivery media. A more detailed treatment of the limitations and potentials of 
CAI are treated in Section O of this handbook. 

Each type of delivery medium has its own unique qualities which make it 
advantageous to use in certain situations. Although the focus of this handbook is 
on CAI, it is important to be able to contrast its strengths and limitations with 
the special qualities of other delivery media. Four broad categories of alternate 
delivery media to CAI are discussed briefly below. 

a. The Instructor. The human Instructor still provides the most 
adaptable and flexible form of instructional delivery. In most Instructional 
settings, the instructor is a critical resource. Thus, administrative structures 
(e.g., group Instruction) are established to make this delivery resource available to 
the largest feasible number of students. Changes In the content to be delivered 
are easily Implemented (e.g., simple annotation of an instructor's lesson plans). 
This delivery resource has time limitation* Students cannot access information 
at will. This delivery resource also lacks reliability In that different Instructors 
can provide Inconsistent instruction on the same objective. However, instructor 
delivery, if time permits, can be very responsive to student needs and can provide 
students with an overall model of behavior to be emulated. The instructor is 
irreplaceable in conveying appropriate attitudes and in supporting and providing 
long-term motivation for students. 
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b. Print Media. This delivery resource is generally unconstrained by 
time. Access to instruction in print form can occur at any time and at any place. 
Of all delivery media, print is the least expensive, especially if large numbers of 
students are to be reached. Printed instructional materials can be easily 
personalized by a student through the addition of notes or marking techniques 
such as underlining and is the most familiar of all training media. However, the 
print media as a delivery resource is constrained by its lack of adaptability to 
student needs. Even printed instruction In the form of programmed texts is 
limited in its ability to provide predetermined alternative Instructional messages 
based on student need or particular errors made during learning. The student 
typically cannot interact with print materials. Modification of printed 
instructional materials can be both time consuming and difficult. Partial changes 
to a document require extensive administrative procedures to ensure that all 
copies distributed over a range of locations are updated. Major changes which 
require reprinting of a set of materials can become costly if such changes occur 
frequently. 

c. Film Media. This category includes both still media, such as 
photographs, slides, microfiche, etc., and motion media, such as movie film. Also 
included in this category, for convenience, are video tape and video disc. The 
film media are generally expensive and can be limited by the special equipment 
required for both production and utilization (projectors, tape players, etc.). Good 
film or video-type instructional materials can provide a »ery concise and 
motivating message to students. Also, this form of instructional delivery can 
represent time-based events in the real world not easily conveyed in either print 
or speech alone. Film-based media by themselves (this excludes film- 
tape/computer hybrids) are not interactive and do not adapt to individual student 
needs. Film- /tape-based instructional materials are very expensive to produce 
and reproduce. For these media there is no difference between a simple 
modification and a major change sLxre bom require a complete revision and 
reproduction of the instructional materials. The time to revise is usually very 
long as compared to either print or instructor- delivered materials. Film/tape 
materials can be used to convey attitudes and provide motivation on a student 
population- level basis, but such materials cannot respond to individual needs as an 
instructor can. 

d. Audio Media. This delivery media can provide stand-alone 
instruction, but is usually used in conjunction with the preceding delivery media. 
As such, it can enhance student learning by providing an alternate processing 
channel— students can both read (see) and hear information. Audio media are 
many times a preferable delivery category for students who have difficulty 
reading. The use of audio for these students can be slowly phased out as students 
improve their reading skills. Costs to make and reproduce audio tapes are 
relatively low and audio tapes, if used appropriately in conjunction with other 
delivery media, including CA1, can meet individual student learning needs. 

e. Adjunct Support for CAU Both print and film -/tape-based media can 
be used independently out often are used in an auxiliary mode to the instructor. 
As mentioned, tape-based materials are frequently being used as an auxiliary 
presentation mode with the computer. In both cases, the instructor and the 
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computer provide a level of interactivity and responsiveness to individual needs 
that the other media do not provide by themselves. CAI should not be excluded as 
an auxiliary support medium for the Instructor, Large-tcreen TV projectors and 
small microcomputers with good color graphics can be combined to provide a 
potent support mechansim for group presentations. Although a major advantage 
of CAI is its capability to provide individualized instruction in an efficient and 
effective manner, group uses of CAI should not be excluded from possible 
applications. 

This is a good point at which to discuss another use of the computer in 
support of the instructional process. In addition to helping provide for the 
delivery of instruction, the computer can be used to support the management of 
instruction. This instructional use of the computer is referred to as computer- 
managed instruction (CMI). CMI is distinct from CAI and provides specific 
capabilities for testing, scheduling, allocating resources, collecting student data, 
and providing status reports. These are the major functional areas of CMI, and 
like CAI, CMI applications range widely in their emphasis on particular features 
and the amount of capability that they provide. A useful way to think of the 
relationship between CAI and CMI is to see CAI as one of many possible 
instructional delivery resources which a CMI system could support and manage. 
Thus, it is possible to have a CM system which simply manages only non-CAI 
instructional delivery m*dia. However, when a CMI system is combined with the 
significant use of CAI, the combination of these two technologies is commonly 
referred to as CB I— computer-based instruction. 

In terms of the type of support provided, CAI and CMI have different 
quantitative relationships to the student population. As will be emphasized 
throughout this handbook, CAI is an individualized instructional delivery medium; 
thus, it has a one-to-one relationship between the delivery hardware G«e«, 
computer terminal) needed and the student. CMI, on the other hand, has a one- to- 
many relationship between its input and output hardware G.e., the CMI work 
station) and the student that it supports. What this means is that for CMI the 
student population can increase within a certain range without requiring more 
CMI equipment. For CAI, increases in student population will typically require 
the addition of more CAI hardware. 

With the exception of the instructor, CAI is the only instructional 
delivery medium which is truly interactive and which is flexible enough to change 
the nature of the instructional message delivered on the basis of its ongoing use 
by the learner. Whereas more traditional forms of instructional delivery media 
(e.g., overheads, f ilmstrips, movies) are best used in an adjunct mode to the basic 
instructor-led lecture or recitation, CAI can be used in a primary and independent 
way to provide instructional delivery. Thus, in those situations in which 
organizational constraints might perhaps limit the availability of instructors or 
where instructor-led activities need to be complemented by more intensive 
individualized work by the student, CAI offers a substantially greater range of 
capabilities than do other instructional media. This relationship of CAI to 
organizational and instructional needs is treated further in Section ILF of the 
handbook. 
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3. CAPs Relation to Instructional System Development ASP) 

ISO, to auote AFM 50-2, «fl§) . . . a systematic procedure for assuring 
application of Instructional technology to course planning and development." 
Further, AFM 30-2 states. The Intent of ISD is to develop QUALITY training at 
the least cost. 1 * ISD Is above all a management process, although early 
applications of it have become closely associated with the concepts of 
programmed instruction and self-pacing. This association has often created the 
impression that the concern of SD has been on improving the efficiency of 
instruction even to the detriment of the quality of Instruction. This handbook 
stresses the fact that self-pacing is merely one administrative technique for 
providng instruction to students, in the same way that group-pacing is an 
administrative technique for providing Instruction. A substantial body of evidence 
has accrued to show that self-pacing as an administrative form of scheduling and 
providing Instruction does produce significant time savings as compared to group- 
paced instruction (McCombs, Sack, & West, 1984). However, just as the quality of 
instruction In group-paced courses is highly or even primarily dependent on the 
quality of the Instructional delivery provided by instructors, the quality of 
instruction in self-paced courses or segments of a course is equally dependent on 
the instructional delivery medium used and on the quality of the instruction 
delivered. 

The Air Force's five-phase process of ISD (analyze, design, develop, 
implement, control) is meant to ensure that appropriate training requirements 
that fulfill the operational requirements for trained personnel are established. 
When training requirements have been established and translated into appropriate 
training and instructional objectives, then step four of the ISD model provides for 
the planning of how these objectives can best be achieved. Part of this planning 
process is to select the appropriate medium and technique of instructional 
delivery. If certain instructional objectives might best be achieved through an 
individualized, self-paced form of instruction, then the decision to adopt CAI as 
an instructional delivery medium becomes relevant. CAI allows a range of 
alternative instructional strategies to be implemented which exceeds previous 
self-paced and individualized media such as programmed texts. In this regard, the 
availability of CAI can provide a powerful Instructional resource to meet certain 
types of training requirements. Within the decision processes required by the Air 
Force ISD model, this handbook should provide the information needed to make 
the determinations and tradeoffs necessary to decide whether or not CAI should 
be adopted in a specific training situation. 
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II. UNDERSTANDING CAI 



A, Why Use • Computer for Instruction? 



A good question* Why would anyone want to use a computer as an 
instructional delivery medium? Consider some of the accommodations and 
changes that will be required in the training environment. First, the training 
environment and/or part of the course must be flexible enough to accommodate 
some Individualized and self-paced instruction, for these are the two major 
assumptions upon which most forms of CAI are predicated. Next, there has to be 
a commitment for hardware acquisition (purchased or leased) and maintenance. It 
is especially important that there is a commitment to acquire the CAI course 
materials— whether the plan is to purchase "cartnetf 1 lessons or to develop them in- 
house. During transition, lesson content validity (teaching what was intended) and 
design validity (material presented appropriately) must be considered. 
Consideration must also be given to updating materials and the resources required 
for this. Finally, Instructor roles in relationship to self-paced instruction have to 
be planned for and implemented. In light of these commitments, the use of a 
computer as an instructional medium must be justified. 

On the instructional side, the computer delivery of instruction and 
practice can provide students with a level of interactive, individualized 
instruction that is difficult, if not impossible, to attain with other media. 
Individualized instruction was the premise on which CAI was originally 
conceptualized and developed. CAI can require the student to be an active 
participant in the learning process. These attributes are not guaranteed in group- 
paced, lecture-type instruction, r.or are they maximized in pa per-and- pencil 
programmed instruction. '* should be noted that CAI does not always take 
advantage of its potential and should be viewed as a tool that makes it possible to 
reach the goal of individualization. 

Institutionally, the computer allows for flexible instructional planning. 
In addition to the delivery of course materials (mainline instruction), a robust 
courseware library can provide the following! prerequisites in instruction, special 
remediation including homework assignments, extensive or adoltional practice 
through drill or simulation, enrichment/elaboration, or basic skills training. CAI 
is available on demand. It can permit flexible scheduling of students and classes 
if an adequate number of delivery stations or terminals is available. For example, 
students may receive elaboration or remediation "after ours," at their own or the 
instructor's discretion. Portions of several courses that have a common core of 
instruction might benefit in terms of costs and standardization if the common 
elements were available via CAI. Another institutional advantage is 
standardization of training; i«e., material and evaluation criteria are standardized. 
Lastly, CAI has been shown in many studies across many disciplines to 
significantly reduce training time to criterion mastery (Kulik, Kulik, & Cohen, 
1950). 
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ft. What Are the Limitations of CAI7 



One of CArs greatest limitations is not a characteristic of this tool, but 
rather, of how the toot may be misused. As with any medium, the benefits of CAI 
are jeopardized by poorly planned development and implementation, eg., limited 
development time, an inexperienced development team, or lack of planning for 
the development of off-line training materials or activities should the computer 
become unavailable to students. The use ofXAI does reouire special support? that 
support must be planned for well in advance. As a medium, CAt can help to 
develop and deliver highly Interactive, individualized courseware instruction. Bad 
courseware does not mean CAI is bad. For example, CAI has, over the years, been 
the recipient of "bad press" because It has frequently been inappropriately (and 
expensively) used only to deliver automated, programmed text. It can do much 
more. The capabilities of the CAI medium need to be brought out and exploited in 
the courseware-developed capabilities, such as branching, dynamic graphics, 
adaptive drill-and-pr actice , simulation, and gaming. So, if CAI is chosen because 
its special characteristics best fit the requirement* of a course, it must be 
remembered that effective use of those characteristics requires special 
commitments to their development and support. 

After having considered underutilization of CAFs potential in the 
development of courseware, the next interest is in concerns and potential 
limitations regarding institutional impacts of the delivery of CAI. CAI creates an 
individualized, interactive environment that can limit human contact and social 
interaction during the time a student is using the system. This may or may not be 
troublesome, depending on the specifics of the application and the trainees for 
whom it is intended. For example, if a course trains recruits new to the Air 
Force, perhaps one of the objectives is indoctrination in values and attitudes, such 
as professional ethics. If recruits interact solely with the computer, such 
objectives may not be easily reached. In this example, perhaps CAI could be used 
effectively to reach the instructional goals by providing basic skills instruction 
and practice with solving technical problems via drill-and-practlce or simulations. 
However, the instructional staff itself would provide the intense interpersonal 
interaction needed to build healthy attitudes and values. 

Up to this point in the dbzussion of limitations, the potential limitations 
of the medium and its use have been related. Another type of potential limitation 
is CAPs impact on the needs and role of instructors. For the most part, 
instructional staff members have been trained in traditional instructor-centered 
classroom techniques! that is, lecture, discussion, and demonstration. For many, 
having the computer provide part of the instructing role appears to constitute a 
demotion of the instructor's role to that of "paper pusher" or H babysitter. 1 * This 
reaction and related resistance are, perhaps, understandable because instructors 
generally believe that they have the expertise, based on experience, necessary to 
provide trainees with the context and meaning for their training. Instructor needs 
must be accommodated. 

The roll of the Instructor can be very different in a training environment 
that uses CAI, but it Is not necessary to view that changing role negatively. In 
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ISlAJZ™** instructor role is mort * nutter of emphasis. In the 
htf vi*rtizetf environment, the instructors rale focuses on each individual 
student's learning needs and on integrating CAI with appropriate individual and 
group learning activities. The tasks of counselor, remediate, diagnostician, and 

SEi£™£ *1 i U l ^ mi,, fL!J5 n * g ? r ¥ d «!?^tor, ff-e ail partof the new role 
(McCombs & Dobrovolny, 1980). It has been essential in most successful 
implementations to train instructors in their new roles, encouraging a creative 
and flexible approach to the more flexible training environment. Many factors go 
into successful projects, but especially important is instructor training and early 
inclusion of the instructor staff in project planning and development To the 
, ! u 1660 ** * nonintegrated technology, separate from the 
mainstream training environment, the implementation will be less than optimal, 
and its results possibly detrimental to the entire training mission. 

There are two additional potential drawbacks. The first is another 
potential misuse of the medium; that is, CAI should be (but is often not) seen as 
one medium in the constellation of media that may meet an instructional need. 
Sv, T* y .5 e w us ? , , ul io ? *° me «N«ctWe§ out not others in a course. The choice of 
CAI should be driven by instructional need for that medium's unique capabilities. 
The second drawback is the typical length of time required to prepare lessons and 
validate them. Although recent advances in authoring of CAI are impressive, if 
only very limited time is available to develop a course, CAI will have a very 
restricted role. * 

To summarize, CAI in and of itself does not guarantee quality 
instruction. Quality Ues in the content and in design of the course ware the t takes 
advantage of the medium's potential for Interactivity. Also, the delivery of 
interactive instruction affects instructor roles, and appropriate adjustments in 
these roles must be made. CAI cannot ^uiiy substitute for direct human contact 
in courses in which the goals are to teacn values and ethics. Finally, CAI should 
oe chosen based on its potential for best meeting instructional or institutional 
needs, and ample development time is essential. 

C. What Are the Unique Potential Benefits of CAI? 

With the exception of a one-on-one tutor, CAI has the potential to 
deiiver the most responsive and individualized instruction of any instructional 
alternative. CAPs unique characteristic is its interactivity. In ail of the different 
modes of CAI (including tutorial, driii-and-practice, gaming, and simulation), 
interactivity plays a central role. When a student finishes a well-designed and 
weli-irnplemented CAI lesson, it is apparent that the student has actively 
attended to the material each step of the way. By use of simple instructional 
games or clever graphics, CAI can also contribute to high levels of student 
motivation. 

Consider a tutorial situation. In lectures, a student can doze off. In 
proyammed texts, the student can peek ahead. But in a CAI tutorial, the student 
must attend to each point of interaction in order to complete the lesson. 
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Moreover, CAI coo adjust the quality and complexity of these interaction* through 
lesson branching techniques. For example, a wrong answer to an embeoStd 
o^on^gPSe met WSTa deeper explanation, with its own £ 
mteraction. Students can also be branched to earlier sections of the lesson for 
review or can be given more condensed or expanded versions of the lesson, based 
on pretest results. 

Let us consider the role of interactivity in practice. Of course a student 
cannct complete a homework assignment by dozing off or peeking atj the answers. 
Often the work as well as the solution must be shown to prove the practice is 
honest. But most people have faced a blank page when even an approach te a 
sXfon escaped men?" The interaction necessary to arrive at even an approach 
to the solution awaits the next class, or help from the instructor. With CAI, 
Sactfce can be interactive Immediately for all students imfiv *^~with 
appropriate prompts and cues for guiding students to problem «* u *™^^ 
SVe problems and work examples. Moreover, rejjetitiveckUl, wWch ^res 
more self-discipline than many students have, can be provided I and e^w<*d 
CAI? Finally, dynamic simulations, approaching sufficient fidelity to substitute 
for actual equipment, can be delivered only through the computer-based medium. 

Some unique potential organizational benefits as well as instructional 
benefits are associated with CAI. Included are the issues > of cost ^tiveness 
and reduced training time. Further in this section is a subsection entitled Will 
Svi be Cost Effective?- that will describe training benefits and cost trajteoffs. 
At this point it is relevant to describe briefly several aspects of CAI that have 
unique organizational benefits. 

1. The quality of lessons, content as well as instructional 
strategy, can be standardized so that all students across 
time can get an equally good lesson. At a time when an 
experienced and trained instructor staff is becoming a 
scarce resource, this could be particularly important. 
Using the experienced Instructors in the CAI design and 
development process is an economical use of their 
expertise and helps assure high quality. 

2. The lessons themselves can be more quickly and 
economically updated if the lessons are systematically 
developed and modularized (see subsection E., "How is 
CAI developed") than can hard copy that has to be 
reprinted. 

3. Automatic data collection that is usually integrated 
within a CAI lesson is another benefit of this medium. 
Reports generated from CAI lesson data that have been 
automatically collected can allow instructors to see how 
students are progressing and where students are having 
difficulty, and can be used to evaluate the CAI itself. 

k. Portions of courses may share the same instructional 
content with several other courses, i-e., basic 
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electronic!, auto repair, or troubleshooting. By 
provkfiftg stands** courseware for s h ared-cor e courses, 
economy may be an outcome in development time, 
instructor delivery time, and potentially, in student 
time. 

In summary, the selection of CAI as i delivery medium entails a careful 
consideration of the requirements, benefits, and limitations of CAI (see Table II- 



D. What Are Basic Types of CAI Applications? 



Over the last 2 decades, CAI has evolved to take advantage of 
increasingly sophisticated hardware and software, as well as advances in cognitive 
theory and instructional design. The basic functions that CAI serves, however, 
have remained the samet the presentation of information, the demonstration of 
the applications of skills and knowledge through examples, and opportunity for 
practice. For information presentation and demonstration, the ways in which 
these basic functions are accomplished range from simple linear information 
presentation to complex, intelligent CAI; for practice, they range from 
nonadaptive, simple problem sets to sophisticated task simulations. 

Described and defined below are the basic strategies or methods used in 
CAL These descriptions are amplified in Section VJ5, which contains screen print 
examples of the methods and strategies. 



1. Informational 

Information can act as part of the instructional process without being 
specifically instructional. For example, during a group-paced lecture, it may be 
important to demonstrate or elaborate on an instructional point. The instructor 
can use a microcomputer and large-screen monitor as a kind of electronic 
blackboard or dynamic slide to show a graphical representation of a process or set 
of procedures. Factual information can be available as an addition or adjunct to 
the instruction, either under lesson control as a prompt to the student or uider 
learner control as an optional HELP. In the course of a practice or problem- 
solving session, the student may require factual information in order to work 
toward a problem's solution! e.g., the problem may require that the student refer 
to a manufacturer's specifications. In this instance, a data base of relevant 
information such as regulations, specifications, or schematics could be available 
to the student. Informational CAI can be used as a dynamic tool, with 
information such as helpful hints or lessons learned added by instructors at any 
time. 
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Table H-l 



Summary of Section II A, B, and C: 
Requirements, Limitations, and Potential Benefits of CAI 



Requirements for CAI 



Limitations of CAI 



Potential 
Benefits of CAI 



Flexibility of course and training 
environment to accommodate self- 
pacing and individual instruction 

Commitment for hardware acquisi- 
tion and maintenance 

Commitment for materials devel- 
opment/acquisition and updating 

Planned changes in instructor roles 
and role training 



Requirements for special personnel 
and resource support 

Potential limiting of human 
contact and social interaction 

Potential for inappropriate appli- 
cation and implementation 

Unable to substitute for adequate 
planning, courseware development, 
and instructor/ staff preparation 



Instructional 

Highly interactive, 
instruction 



individualized 



Instructional and scheduling flexibility 

Consistency of training, material, and 
evaluation criteria 

Higher degree of student activity, 
attention, and motivation 



Organizational 

Potential cost effectiveness and time 
savings 

Automatic data collection 

Capacity for quick and inexpensive 
update of materials and tests 



2. DrUl-mnd-Precticc 



Applying what has been learned through practice problems is a very 
important and essential part of the learning process. Practice not only verifies 
that the learner can actively use concepts, skills, and procedures which have been 
taught, it also affords the learner the opportunity to practice transferring and 
generalizing concepts and strategies to problems dissimilar from examples 
demonstrated. Practice provides opportunity for enhanced learning through 
provision for multiple encoding; the more ways one stores information, the more 
ways one can get to the information learned, and the better that information will 
be remembered. 

The rather stereotyped view of computer-assisted drill-and-practice is 
exemplified by problem sets of simple math fact problems or sets of multiple- 
choice questions that quiz the learner about factual information. However, drill- 
and-practice can be a good deal more sophisticated. For example, even with math 
facts, the computer can keep track of the facts that are most difficult for each 
student and adapt the questions to reflect the need for additional practice in 
particular areas. The drill-and-practice technique is commonly used to quiz 
students on nomenclature (e.g., parts of anatomy, parts of a vehicle). It is also 
used to drill students on parts of a process; e.g., what do you do after you have 
installed the condensor or what do you do after you have secured the patient on a 
stretcher, etc.? Often, instruction may be delivered by instructors or another 
medium while the computer will be used for the drill-and-practice. Thus, drill- 
and-practice is often provided at the subtask level. 



3. Tutorial 

In tutorial CAI, the computer presents instruction. Frames of text and 
graphics are typically interspersed with embedded questions such as constructed 
answer, true/false, multiple-choice, or matching questions. Immediate feedback 
messages and schemes (including branching to remediation or elaboration 
segments) are, in good measure, what makes the lesson a tutoring experience. 

One of the original intents of CAI was to provide for a Socratic-type 
dialogue between the learner and the computer. To be truly Socratic, tutorial 
CAI must be able to adapt to the nature of the student-computer interactions, to 
diagnose faulty reasoning or misunderstandings, and to guide the student toward 
the objective. To be truly a dialogue, there must be provision for the student to 
ask the computer questions as well as for the computer to pose questions to the 
student. A dialogue is a two-way communication. 

The history of tutorial CAI has, unfortunately, in many instances not 
lived up to the original expectations of educators and trainers. For the most part, 
tutorials have not been dialogues; they have been linear, nonadaptive programs. 
Designers and programmers have had to "fit" the embedded questions and 
responses and branching options into sets of probable student responses. The 
results of this design approach can range from quite adequate to woefully 
inadequate, depending on careful planning of the designer and on the Homogeneity 
of the student population and their probable responses. Designing elaborate 
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strategics for learner and prop-am control over the flow of the lesson nas proven 
to be very time consuming and difficult, etpect aMy for designers new to the 
potentials of the medium, and for subject-matter experts with little training or 
experience in learning theory, individual differences, etc. The result has been a 
lot of "tutorials" that are linear, not highly Interactive, nonadaptive, and that 
take a view of the learner as a passive redolent of information. The term "page- 
turner" has often been used to describe this type of CA1, a kind of automated 
programmed text. For the most part, very little is to be gained from using the 
medium In this manner. Because tutorials have not, for the most part, been 
developed along the lines which were originally Intended, they have gotten a 
reputation as Ming an expensive and often frustrating or boring mode of 
instructional delivery. Some high-quality tutorial CAI has been developed over 
the years and exemplars can be found in most commercially available CAI 
systems. AddtionaUy, systematic methods for developing tutorials that will help 
authors turn out instructionally sound materials have been designed and 
documented recently. 



». Simulation 

Simulation as a form of CAI gives a student an opportunity to practice 
whole procedures and tasks or to solve problems In life-like or job-like sequences. 
Typically there is no single correct sequence of action in the tasks or problems 
simulated. The state of the simulation depends on what the student has done up 
to a given point In the task or problem, and what must be done past that point is 
determined on the basis of that performance. 

For example, consider a first aid simulation. Depending on the 
particular first aid actions taken, and on the order in which they are taken, the 
patient may be helped and stabilized or further harmed. Simulations usually 
operate in cycles. Each cycle begins with a simulation In a given state. In this 
example, the simulation begins with the state of the victim just after an accident. 
Given that state, a variety of actions are possible (e.g., treat for shock, treat for 
bleeding). The student takes one of these actions and this puts the simulation in a 
new state. The simulation proceeds through repetition of this basic cycle. 

The state of the simulation can be presented at various levels of detail. 
For example, the first aid victim could be represented simply by a few descriptive 
words on a display screen, indicating his or her vital signs. On the other hand, in a 
currently existing simulation of emergency caroTo-pulmonary resuscitation 
techniques, the degree of "fidelity" to the real world is much higher, and the 
patient is represented by an actual mannequin. 

A simulation can merely "stand In steacf of an actual object or system 
and faithfully mimic its change in state and response to student actions. More 
useful, however, is the simulation which interacts with the student, coaching him 
or her and providing feedback on the effectiveness or advisability of actions 



22 

31 



~n help SZ^X*SX C *~ ,i<tate " UtrUCti0Ml W>d " to —* — 

• Reliance on expensive, scarce, or potentially hazardous 
actual equipment. 

• Time required to gain relevant practice. 

• Exposure to danger. 

Simulation is an excellent way to prepare students for later actual equipment or 
problem-solving situations. s ^ 

A special form of simulation is gaming. One has only to watch the 
Solfrr^^ 0 ^ Video tolee the pSwerfi effelu sucS 

S^SSi r t<5gi f * Ca " haV ? 00 Student motivation - From an instructional de^ 
l^S.'^ 8 , Strate Jf leS ^ 1,0 or compUcated, can involve staticTr 

22 ^ 4 ^y *nimatedT graphics, or can be programmed for use by individual 
students or in a competitive team context. For example, for simple tasks in 
which students are required to learn lists of techTcTterms ^r stew in a 
att^T^'T 9 ? amin : g techniques-such as havin7^uoenr«t and 
tl^Zl TJ^T lear ; mnS time 8°^' * h «* the computer keeps score and 
provides feedback-can increase student interest and learning in an otherwise 
boring and repetitive task. More complex gaming techniques cln indude the use 
^acK that Probe " P^Pt lea <™ <>" tutoriaToTorm! 

«f . , «• ThC Ch ? iGC of ^ min « applications is best determined by a consideration 
It T,? 8 [! quirements and student characteristics. Gaming is appropriate for 
potentially boring, rote learning tasks or for complex and oifficultTocedural 
tasks that can benefit from the stimulation of student interest. Gaming mTy aTso 
be appropriate for students with motivational problems or who have had histories 
of academic failure. The ultimate decision to use gaming strategies rests on 
course objectives student characteristics, the creativity andVxpertiS of "he Ca" 
development staff , and the time available for CAI development? Some potential 
good sources of additional information about gaming strategies c^TbTfo^d in 
the work of Dodge (1979, 1980) and Mai one (1980). 8 " ™ in 

5. Inquiry 

instil*? ml< *H Z mty °i ***** CAI ls in who defin * s the objectives of the 
instructional event* the student or the course developer (from the SoeciaJtv 

JiafotS^r^, In T 7" ° f the atudent Stroll me 

dialogue, in tutorials, objectives have been defined by the author or develooei 
Although the means for reaching the objectives rnay be as f le^We a^n 
intelligent CAI or as relatively inflexible as in very linei tutodal CAfl I Inaulrv 

21 A.*? * PP °*2 tC lnfofmatio " CA 1 * i« *> interactive instructional experiencViS 
which information, concepts, and/or rules may be supported with examSTs and 
after which practice may be available at the user's a4 the WsSL 
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This particular form of CAI is especially appropriate to those who need 
refresher or brush-up training in very specific areas. Inquiry CAHs^^cuiirly 
"useTTiendly," often employing a series of menus from which to make 
information or instruction selections. In some cases, the user/learner may query 
the computer for specific information or instruction using the keyboard for 
English language input. 

6. Intelligent CAI 

As mentioned in the section on the tutorial, it is not easy to create 
courseware that emulates the one-on-one interaction of an Instructional dialogue. 
Over the years, techniques have been developed that help approach this ideal. 
Taken collectively, these techniques are known as I CAI. 

Specifically, It has been learned that in order to provide Socratic 
dialogues or meaningful coaching, three components of knowledge must be 
brought together and coordinated in the lesson. The first component that is 
squired is subject-matter expertise. The computer Itself must know how to solve 
the types of problems it is trying to teach, just as a human teacher would. 
SecondTan accurate model of the student's current state of knowledge is required. 
What does the student know, what does the student not know, what 
misconceptions does the student have? Finally, using these first two components, 
the third is invoked* the rules of how to conduct an instructional experience (the 
means to master the Instructional objective)? Included here is when to ask 
questions, when to tell or illustrate, when to review, etc. 

I CAI is not yet a fully mature technology. The authors know of no ICAI 
courseware in routine instructional use. But its time has come, and the hardware 
and software exist to support some development. In many ways it serves to define 
what quality courseware should be, and its techniques can now be used in a limited 
manner in the design of more conventional tutorials. 

In summary, several approaches to CAI are available. These applications 
are listed in Table H-2. 



E. How Is CAI Developed? 



1. The Problem 



Although this is not an implementation manual, development issues are 
discussed briefly since they must be well understood in order to make an informed 
choice about whether or not to adopt CAI. Whether the plan is to develop 
courseware in-house, to have lessons developed by outside contractors, or to 
purchase/use existing courseware, it is important that the courseware 
development process be understood so that cost, development time, and staffing 
requirements can be realistically anticipated. If the d«velc>pnient of^urseware 
bycontractors is being considered, then the requirements must be specified and 
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Table H-2 
Summary of CAI Applications 



Types of CAI 
Applications 



Purpose/Application 



Informational 



To provide additional adjunct factual information during procedureVlearning or problem solving 



DrUl^Practice of concepts, skills and ^ocedures learned or provide 

lwiSnT"* inStrUCti ° n ** 3 two " way infraction and encourage active responding during initial 



Tutorial 
Simulation 

Inquiry 

Intelligent CAI 



*JZ£?'J£L S!L Procedures or problem solving in life-like or job-like sequences or 
situation^ can reduce reliance on expensive, scarce, or dangerous actual equipment. Gaming 
enhances learner motivation on repetitive, rote, or complex learning tasks 8 

To allow learner-directed learning or review in specific areas 

To provide highly interactive, two-way dialogue that approximates human tutoring 



provisions made to evaluate the product. Production cost will be better 
understood if the resources required for the different types of CAI are inown. If 
in-house development of courseware is being considered, again there will be a 
need to specify requirements and be able to evaluate the resulting product. In 
addition, a CAI development staff with special skills to fill specific roles must be 
acquired, or else personnel must be trained for those staff positions. 

Specific development roles and skills are in large part dependent on the 
approach and process used to design and develop courseware. Further in this 
subsection, a number of different CAI development approaches currently in use 
will be described. There are pros and cons with each approach, and the one 
chosen will depend on a number of factors, such as the following: 

• Staffing resources - Is there an existing CAI development 
infrastructure, perhaps at the center-level or would this 
need to be developed? 

• Development aids - Will CAI be developed using a 
development system that includes authoring tools, or will 
the work be done without those aids? (For a description of 
classes of design and development aids, see Section III.C.) 

e CAI methods - How complex will the CAI be? Will very 
sophisticated simulations be developed or will less complex 
informational CAI be acceptable? 

Whichever method is used to select a CAI design and development task, 
whichever approach may be adopted or adapted, the moat important thing is that 
it should be controlled and systematic If the project is systematic, more of a 
science than an art, then a necessary step has been taken to ensure timely 
development of sound CAI as cost efficiently as possible. 

Assume a course has been through the BD process and one or more 
instructional objectives are potential candidates for CAI treatment. After 
targeting an objective, the next step is deciding whether the use of CAI meets an 
instructional or organizational need. The objectives themselves will help 
determine the appropriate CAI method to use. 

Having decided on a specific form of and role for CAI, its integrated use 
in the course will need to be considered. Will its adoption be disruptive to the 
course or course staff? How « ill revisions be made? Are revisions to the content 
expected to be frequent/ He uff be trained and transitioned into using 

CAI in the course? Will they t* « «*e benefits to or disruption of their 
traditional instructor roles? Let us assumf that, after the resolution of these 
concerns and considerations, it is decided that CAI is going to be used in the 
course. Now, how can a form of instructional delivery be developed that takes 
advantage of some of the individualization and interactive characteristics not 
usually found in other instructional media? 
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2,_ CAI Design and De velopment Approach** 

mm ^5 **** l ? years » several courseware design and development 

hSTShSfi? ™« of these approaches haveSSS 

been identified with specific hardware systems, it is unfair to tie apwoachesto 

oeSm? th^If M V lnd have and ^dTSSKJj 

^«L^Kii Vln * lorce * ^velopment of CAI regardless of Si 
trtT!™ iyftem - A » earlier, there are pros aVd cons for each 

iLS j^lL^T 1 ™^™^ lt mi ^ t * ™> st hdpfj to colder 

stiff ilEFSZJ** ™ the , if 0Wn meritl Md «cond, with a specific course, 
staff, fiscal, and time constraints in mind- ^ ^' 

Four possible approaches are offered below. 

systematic jf-^ll.l-^ ljS &3=* Pro?r^^r-A,,th^ This is the least 
yiTZ*,l i t P 0 ^^ approaches to CAI development. It has been widely 
used with variable success. Typically, a subject-matter exoert (SMEl iJTm. » 
programming or authoring language (seV glossary rtl IlTc ^and^ieSs to 
program lessons, typically -tutorials." ^Sometimes this ap^ScWuSelsfS 

• The author is enthusiastic and can get others to see the 
potential of the medium. 

• The author intuitively understands the learning process and 
can organize the content and sequence the lesson to 
incorporate good instructional design. 

• The author can organize the actual program such that it 
can be readily changed or updated by subsequent 
instructors or SMEs. w 

More often this approach has been notably unsuccessful because: 

• The author considers the medium as a kind of automated 
characterisScs*^' " 0t taking advanta «e of its unique 

• JJ? e a , ut i or develops the lesson to take advantage of the 

c ^ acteristi «r s oi the medium (e.g., graphics or 
color) for their own sake, without considering the impact 
on student learning, and spends most of his or her time on 
this part of the development. 

• The author does not carefully organize and document the 
lesson. As a consequence, when the lesson needs to be 
updated by another author, the task is impossible, and the 
original effort is lost. 

■ / lf pr °L^i? t 1 1716 Tra fP! ion<lJ , Bggi gggent Team. This approach also 

faffed Hini ™° pttr * Wi ? * a W»"»mh| or authoring Unguage 
(see Section IILD). This approach most of ten uses a team* 
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• The instruct! 
-eHortT 



the cuvi if kvjmviiwij *••*"'»—••» — — — o 
interactions, and providing the instructional strategies. 

• The subject-matter expert, who is responsible for providing 
the lesson content tor tutorials, the data base content for 
informational CAI, the practice items and context for 
drill-and-practice or, more representationally, for 
simulations. The SME is an integral part of the team but is 
more visible during the design and validation parts of the 
development effort. 

• The programmer, who is responsible for coding and 
documenting lesson content and sequence as specified by 
the designer and SME. 

• Other skills used in the team approach include graphics 
design, typing/data entry, technical editing. These skills 
are often incorporated in the roles of instructional 
designer, SME, and/or programmer and are more or less 
important in themselves depending on the size of the 
development effort; i*., each role is individually important 
to a 300-hour CAI development project but may be 
subsumed under another role in a 2-hour CAI project. 

This team approach is fairly standard among professional courseware 
developers. It takes advantage of the real expertise of each team member, not 
expecting those people to learn new skills (e.g., an instructional designer learning 
to be a proficient programmer). After working with the SME in developing a 
lesson script, the designer and programmer usually work up a flow chart for the 
lesson. This flow chart, plus the lesson script, are the documents used by the 
programmer to code the lesson. Although this approach helps ensure the quality 
of the courseware, it does require significant communications and resources 
commitment. This resource requirement has been the catalyst for the 
development of significant authoring aids that either minimize the need for a 
programmer by providing editors that help developers create text and graphics 
frames and the logic that strings those frames together or else minimize the need 
for the designer and programmer by providing these tools plus instructional 
strategy-specific design editors. This more complete tool has been implemented, 
at this time, very incompletely but holds promise for more efficient and effective 
courseware development in the future. 

Approach Ct The Computer-Supporte d Development Team. This 
approach assumes that editors are available that simplify text, graphic, and 
simple program logic specification and entry (without programming). This 
approach still requires the SME and the Instructional designer. In adcltion, a 
programmer may be needed for the implementation of special routines or 
branching or probably complex or animated graphics. Developing a lesson outline, 
script, and flow chart is still necessary and should be completed before the lesson 
is developed on the computer. 
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. ^ A variation of this approach was developed and is currently being used 
for the first time in a vary large CAI development effort by a major corporation 
whose computer-based education group was tasked with developing 200 hours of 
CAI in the area of aircraft maintenance. To systematically accomplish the huge 
development effort while maintaining Quality control, this corporation designed a 
plan whereby SMEs were used as CAl authors. Tne difference betweerT this 
1 ,"lj*f pf0acf L A de » crifaed ««f««r is that, in this case, the SMEs were 
briefly trained in specific, relevant Instructional design issues and were given 
development guidelines and standards and style guidelines. They have the 
responsibility to check at specified intervals with the unit or team manager who is 
an instructional designer. The SME is also responsible for using the text and 
graphic development editor and the simulation development editor to enter and 
edit the on-line instruction, practice, testing, and simulations. Graphics artists 
are used for graphics design. 

, t Approach Dt The Com outer-Guided Author. This is a new approach, 
requiring highly sophisticated development tools that help a design-naive SME 
make good decisions about the instructional design issues involved in the 
development of quality CAI. These tools are just now becoming available and are 
relatively expensive i tee Section IH.C.4). More and more flexible development 
aids of this sort will become available because they will allow the time- and 
resource-efficient development of quality CAI. Seme preparation for the design 
editor-human developer interaction is still required, but the computer-based 
editors themselves will be able to provide some qualitative information to the 
author and prompt the developer with course information necessary to create 
instructional sequences. 

F. How Can CAI Meet Organizational and Instructional Needs? * 
^ The Air Force provides the following instruction in the technical training 



context: 



1. Primary or mainline training, which is the course content 
itself. 

2. Remediation that provides alternate instruction in 
unmastered course objectives. 

3. Enrichment and course elaboration to take individuals 
beyond minimum co instruction. 

k. Refresher or brush-up instruction to previously trained 
individuals. 



# . 4 . formation for this section is based heavily on information provided by 
the Air Training Command. 
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5. Course prerequisite or fundamentals to bring entering 
behaviors up to par. 

6. Basic and study skills development. 

The Mr Training Command has an annual matriculation oi over 270,000 
trainees in over 2^00 courses. Of the seven major mission tasks for ^JgJATC Mta 
responsible (information presentation, demonstration, drM-aJid-practice, 
SSon, fe^back, remediation, and data collection), six « -Ugctfc 
instructional while the seventh is an instructional management task. ™s^«J1cnj 
is currently experiencing a severe strain* More and more is bei"g deinanded oi 
S,SSctors y and^ instructional resources, while the trained inductor *Ut 
continues to decline. The Air Force is experiencing a pressing need to train more 
first-term airmen while at the same time suffering retention problems with 
longer-term personnel who can act as experienced instructor staff. 

In addition to the pressing resource problem is the need to provide 
technical training on increasingly complex equipment and with increasingly 
complex processes. With the decrease in resources and the increase in demand for 
more and more complex training, ATC is looking for means to provide more 
instruction while maintaining quality control. 

The use of CAI holds the promise of providing a tool to help bridge the 
discrepancy between supply and demand. Specifically, CAI can provide < flrect or 
adjunct support for meeting the first six previously mentioned major ATC mission 
tasks. 

As noted in the subsection entitled "What are the limitations of CAI?" 
and in the subsection following this entitled "What are the organizational Impacts 
of adopting CAI?" CAI cannot meet all of ATCs instructional requirements! and 
the impact of implementing the technology takes careful planning, 
accommodation, and investment. 



G. What Are the Organizational Impacts of Adopting CAI? 



There are two broad areas in which CAI development and 
implementation will impact and change most organizations! 

• Resource Requirements 

• Organizational Infrastructure/Technology Adoption 

Each will be described separately; however, there is at least one umbrella 
management issue for both area* the requirement for careful short- and Jong- 
ranee planning for project development, Implementation, and ongoing support. 
SpecifiS, detailed descriptions of requirements will be covered in Section III. 
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1. Resources 

The major resources categories include hardware, software, courseware, 
physical and human factors, and personnel. Some of the institutional impact 
concerns in each category are described briefly below. 

a. Hardware. The management of an organization implementing CAI 
will find it essential to perform a survey or needs assessment to determine 
hardware requirements even if only a small need is anticipated. How much 
hardware is needed, for the short term and for the long term? What type of 
equipment will be required, from stand-alone microcomputers, to clusters, to a 
large networked timesharing computer with terminals? What functions will the 
system be required to perform? 

A small sampling of plausible tradeoff scenarios that will result in 
differing hardware decision outcomes follows* 

• Wilt there be one course of 15 students of whom only a few 
will use CAI for basic skills upgrading, or must there be 
enough hardware to support several courses with a large 
number of students who wUl use CAI for much of their 
normal curriculum? 

• Should equipment be leased because the need is limited or 
of short duration, or should the hardware be purchased 
because the need is substantial and is expected to be 
ongoing? 

• Does CA! software exist that can be used on the existing 
hardware— and at what cost to the other functions the 
current system must perform? (The issue of using a 
currently functioning noninstructional computer to perform 
the instructional function as well is extremely complex and 
will not be treated in depth in this handbook.) 

• Will the hardware be required to support functions such as 
animation, color, etc., or will simple black-and-white 
displays that support line-drawing-type graphics be 
adequate, or are graphics required at all? 

• Should the hardware be available in several locations at the 
training center so access to terminals is convenient and 
logisticaiiy appropriate for all users (instructors and 
students alike), or is the training center compact, with a 
potential computer-based instructional center easily 
accessible to courses and personnel that require it? 

b. Software. Software decisions will also be based on the results of a 
survey/needs assessment. Software is an essential part of the computer-based 
resource requirement. Software provides instructions to the hardware and can 
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roughly be categorized into the following; the operating system that gives 
instructions to the hardware, allowing computer programs and equipment 
(including computer languages; to function; computer languages that allow a 
programmer to address the computer efficiently; and application programs 
written in computer languages that perform or allow specific functions and 
human-machine interactions. 

For example, assume work is being done with one of the popular 
microcomputers. That micro might have an operating system that allows the 
computer to receive input from an attached computer keyboard and give output 
through a TV screen. Compatible with any particular operating system and 
specific micro are several computer languages, such as BASIC and PASCAL, with 
which application programs are written. One such program is VisiCalc, a financial 
spreadsheet program. 

There is a kind of program termed instructional software. Instructional 
software helps instructional designers/ authors create material to be delivered on 
the computer. Instructional material delivered on a computer, is termed 
courseware. Just as VisiCalc (the tool) should be distinguished from a given, 
specific financial spreadsheet (the product), the distinction between instructional 
software and courseware should be clearly understood. 

c. Courseware. As stated previously, courseware is the generic term for 
all types of CAI materials. (The Navy uses the term lessonware instead of 
courseware.) Courseware is a resource that can be acquired in already developed 
programs. However, in most cases, it is developed by the potential user. In the 
future, there will be libraries of courseware just as there are libraries for paper- 
based materials, but for the present, it will be important to plan either for the in- 
house design and development of courses involving some very specialized 
personnel skills or else for contracting with an outside developer for the materials 
(see Section V.A). 

Once the materials have been developed and validated and are being 
implemented, resource personnel for courseware revision and maintenance will 
need to be considered. This process should be planned for at the beginning of a 
project. For example, if the materials are anticipated to need frequent revision, 
the initial development of the materials could be accomplished in such a way 
(e.g., through modularization) as to facilitate the revision process. Recurrent 
need for courseware updating and revision will be an important input to the 
decision regarding in-house or outside development. It will also be a consideration 
in the decision as to how the courseware is produced G.e., via programming or 
through authoring editors). 

d. Physical and Human Factors. The use of CAI requires special thought 
and consideration for its housing and the housing of the necessary development 
and support personnel. The hardware, associated documents (e.g., workbooks), and 
furniture <e.g., carrels, tables, chairs) all need to be financed and procured and 
will require space. Some computers may require special electrical hook-ups and 
air conditioning. Changes to classroom faculties also have to be assessed (e.g., 
room size, carrel layout, instructor station), as well as a variety of human factors 
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issues in classroom design (e.g., lighting, air quality, room color, other comfort 
factors). All of these considerations have to be taken into account to some 
degree when planning for the development and Implementation of a CAI project. 

c. Personnel. People issues need to be considered: numbers, needed 
skills, roles, and training. Consider this representative list of roles generally 
required in CAI development and implementation of any magnitude: 

1. Managers. These personnel are in charge of developing 
the course training standards (including media selection 
decisions); keeping development on target, both in terms 
of development schedules and quality control; overseeing 
the CAI center if there is a center; and managing both 
courseware and hardware maintenance. Cost control and 
fiscal management are also the manager's responsibility. 

2. Developers. Instructional designers, subject-matter 
experts, programmers, and graphics artists are needed. 
Personnel with these skills create and maintain the 
courseware. 

3. Advocate/Promoter. If you plan to have a viable CAI 
center, research has shown that it is very important to 
have one or more people promoting project visibility 
within your organization, top to bottom. Even within a 
smaii project Q.e., with a single course), it is important 
to have a person responsible for "consciousness" of the 
potentials of the medium as new personnel rotate in and 
out of the course. 



2. Infrastructure—Adapting for Chanze 

What organizational infrastructure does CAI require if it is to be an 
effective, efficient, and accepted component of a specific training program? 
There are at lea*t two requirements: 

• Facilities 

• Communication among personnel affected 

Section II.G, regarding the institutional impacts of adopting CAI, 
mentioned the range of possible hardware configurations and the ways in which 
training requirements affect hardware selection. Whatever decisions are made 
regarding hardware, it is absolutely essential that the users of the equipment have 
adequate access. In a comparative analysis of numerous successful and 
unsuccessful CAI projects (Avner, 1977), aeons to terminals was cited as one of 
the major indicators of success. In assigning space in a facility for CAI, consider 
the following question: "Am I maximizing access to the terminals?" 
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To illustrate this point, consider two options: (either might be the 
preferable one in a specific situation). Option 1 is to centralize access and put all 
terminals in a big center, and Option 2 is to decentralize terminals or 
microcomputers in course classrooms or offices. If many of the courses will be 
100 percent CAI, or If many of them will use CAI as "homework" outside of class, 
a centralized configuration of terminals might be preferable. But if a course 
incorporates some CAI but is not totally CAI-based, a long trip down to the CAI 
center might dissuade course supervisors from a continued commitment to CAI 
because of the logistics of arranging for the transportation of individual students 
to a central CAI facility. 

The centralized approach is attractive in several ways. Maintenance and 
management by an infrastructure of CAI staff members of courseware and 
hardware can be more easily accomplished if the equipment and staff are in a 
single location. But this centralized approach also has two potential drawbacks. 
These potential drawbacks should be considered when planning facilities in 
conjunction with potential use of CAI in a particular course. A recent study of 
the factors critical to the success or failure of self-paced instruction in the Air 
Force (McCombs, Back, & West, 1984) indicated that both the literature and case 
studies have shown that courses which are 100 percent self-paced have seldom 
been successful. Self-pacing only that portion of a course which lends itself to 
the self-paced format fend similarly utilizing group-pacing and all other 
instructional approaches where they appear well suited) yields superior results. 
With this in mind, very few courses should be 100 percent self-paced or 100 
percent CAI, and this suggests only infrequent justification for a centralized room 
of student terminals. It also suggests the need for very flexible scheduling. 

The second potential drawback is that CAI is a fairly new medium for 
many instructors, developers, and students. It stresses individualization and 
interactivity. In many ways it goes against the grain of established, instructor- 
centered training practices. Given that a good case is built for this new medium 
for a training facility, an additional need is to plan for overcoming a natural 
resistance to CAI in particular and to change in general. Locating all terminals or 
microcomputers in one large center may minimize the effective visibility of the 
innovation. Maximizing the visibility can be attained by installing terminals or 
micros throughout the facility. Gradual introduction of CAI to staff and students 
could be accomplished by using it for simple functions like completion of 
homework. 

The second "infrastructure" is people. Unless a network of commitment 
to CAI is fostered, the successful adoption of CAI will be in jeopardy, and may 
even be actively sabotaged. The late President Lyndon B. Johnson once remarked, 
"If they're not in on the takeoff, they won't be in on the landing." Designers, 
supervisors, instructors, students, and evaluation teams must be involved as the 
project takes off. No instructional approach will work if these groups of 
individuals are not committed to a common objective. The establishment of an 
infrastructure to support communication among these personnel, in the final 
analysis, is the most important challenge in successfully launching a CAI project. 
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3ust as it is important that the various rote players have access to each 
other from the beginning, it if important that each role player has convenient 
access to theCA! medium. If it is difficult for instructors to get on-line, then it 
is harder to win their commitment to CAI. Work toward fostering a sense of 
"ownership" among the personnel. If the course ISD personnel do not have 
meaningful, job-related access to the new CAI system, they will be discouraged 
from becoming involved. It may be very helpful to acquire some technical 
assistance formally through consultants within or outside DoD when considering 
specific personnel infrastructure options. Informal contact with others within 
ATC who have faced a similar situation may result in help from their "lessons 
learned." Some of this assistance/ referral information has been supplied in 
Sections I and V of the handbook. 

The CAI medium itself may be the best ally in setting up communication 
among role players. For the smallest applications, networking may not be needed. 
But for larger applications, networking of hardware may be a catalyst for 
communication. This may be limited to a kind of "mailbox" feature whereby notes 
between users can be "sent" and received on the terminal. This may be extended 
to elaborate integrated design, development, delivery, and evaluation systems, of 
which computer-managed instruction may be considered a prototype. 

w .. In sum » adoption of CAI requires providing easy access to terminals and 
building a people infrastructure. Computer networking provides a means to meet 
each of these requirements. 



H. Will CAI Be Cost Effective? 



This section Is provided to identify relevant issues and to summarize 
current research on the cost effectiveness of CAI, since costs are a basic issue in 
the consideration of system change. 

Cost-effectiveness R&D relates the costs of Instruction to quantifiable 
measures of the effectiveness of graduates as the result of the training received. 
According to Orlansky and String (197?), there are two ways of evaluating the 
cost effectiveness of alternative military training systems. When comparing two 
systems of the same cost, the system that provides greater effectiveness would 
be, of course, preferable. When comparing two systems of the same level of 
effectiveness, the system that costs less would also be preferable. All military 
studies of CAI have used the latter approach. 

In order to assess the effectiveness of CAI, perform the following 

analyses: 

1. Identify the costs of traditional instruction 

2. Identify separately the costs associated with the 
development, implementation, and operational! zation of 
CAI instruction 
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3. Measire the effectiveness of trainees in the field who 
are graduates of each mode of instruction 

4. Identify the costs of repairing any deficiencies 
associated with the current training methods 

5. Compare the two systems to determine if the investment 
in CAI is warranted* 

In general, there are few baseline data available on the performance 
effectiveness of Air Force technical training graduates with which to contrast 
CAI-trained people; therefore, there is no body of literature that can be used as 
reference when estimating probable cost effectiveness. As an alternative to 
performance measures, most studies rely on training objectives with which to 
compare effectiveness, by posing the question: Will CAI improve the performance 
of students as measured by test scores, time to completion, and amount of 
material covered? There are many problems associated with this alternative. 
Orlansky and String (1979) listed the following: 

Student achievement in school as shown by test results may 
serve as a proxy (or predictor) of future field performance, 
and hence, training effectiveness. However, correlations 
between performance at school and on the job have not been 
established for any method of instruction, and the use of 
results collected only at schools cannot be taken to be 
conclusive. 

Such data (supervisor ratings) are subjective in nature and 
may be influenced by factors not related to training, e.g., 
relevance of the training course to the actual job, nature of 
the work environment, personality, and so on. 

The effectiveness of computer-based instruction for teaching 
a particular course should be compared to that of 
conventional instruction by measuring how well graduates 
taught either way perform the same tasks in the field. 

To the extent that student time is relevant to the analysis of 
cost effectiveness, it is a measure of the cost and not of the 
effectiveness of training. 

Research stucfies on the cost effectiveness of CAI have been 
inconclusive. While most studies have indicated that CAI results in significant 
time savings when compared to conventional instruction (3amison, &ppes, & 
Wells, 1974; Kuiik, Kulik, & Cohen, 1980; Sprecher & Chambers, 1980), ottos 
report that CAI saves little time beyond that saved by manual individualized 
instruction (Orlansky & String, 1979). Studies conducted to estimate the training 
effectiveness of CAI are rare. Most cost studies i have been concucted 
independent of effectiveness (Shavelson & Winkler, 1982). Braby et ^975) 
have developed, "A Technique for Choosing Cost-Effective Instructional Delivery 
Systems," which includes CAI. 
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Section 111 of this handbook provides some guidelines for estimating the 
costs of procuring and maintaining CAI system components. CAI systems range 
from very small and simple to very large and complex* to order to estimate the 
costs of implementing and maintaining a CAI system, the design characteristics 
must first be selected based on training needs. Sections in and IV provide 
assistance m the selection of specific features and configurations of CAI that 
might fit some specific requirements. 

Cost estimates are extremely variable. Orlansky anc String (1979) 
suggested that the most meaningful relationship for comparing CSI with other 
methods is the cost per student hour. Hickey (1975) estimated the cost of CAI 
lesson preparation to range from 40 to 200 hours of instructor preparation time 
per hour of presented lesson, at an average cost of $l,000/hour of lesson 
presented. If the preparation cost was amortized over 4 years, estimating 200 
students per year, it would be approximately $1 .25/ terminal hour. Given these 
estimates, it would appear that CAI is efficient only in courses with high student 
flow. While accurate in 1975, Hickey's estimates do not reflect current costs for 
CAI preparation. 

Shavelson and Winkler (1982) reported tha* estimates of the cost of 
developing an hour of courseware vary between $300 and $3,000 and that the cost 
of CAI delivery varies between $0.40 and $28.50 per student hour. They 
attributed some of these cost differences to assumptions made about system 
components, rate of use, and life span of hardware and software. They predict 
that advances in courseware development software, such as authoring and design 
systems (see Section III.C), will have a major impact on courseware development 
costs from now on. Additional variables they identified as influencing costs 
include student characteristics, quality of courseware, and type of instruction 
(drill-and-practice, tutorial, simulation, etc.). Further, they cautioned that most 
studies focus on hardware costs, and Levin and Woo (1980), reported in their cost 
anal /sis of a time-sharing system that computer equipment represented only 
about 28 percent of the total annualized costs, so that even if equipment costs 
declined by one-third, total costs would be decreased by less than 10 percent. 
Shavelson and Winkler also cautioned that shifting instruction from a labor- 
intensive (teachers) to a capital-intensive (equipment) effort may be an illusion in 
that rather than reducing personnel, the introduction of CAI may simply affect 
the skill mix of instructional personnel and related staff. It should be noted that 
the data in the Shavelson and Winkler paper, as well as most other published 
papers, were derived from public educational and not military training systems. 
The impact of this fact on interpreting the data for military training systems is 
probably substantial. 

Most decisions to implement CAI, therefore, are based on the 
consideration of benefits rather than on cost effectiveness. Numerous studies 
have indicated that CAI raises student achievement, reduces training time, and 
engenders positive attitudes toward the computer. As with any form of 
instruction, the quality of the courseware, the nature of the instructional goals, 
and the type of CAI used are all Important variables* Quality of materials is 
particularly important in this medium. Most researchers agree that since 
methodologically adequate cost effectiveness studies of alternative mixes of 
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instructors and computer delivery mixes are not generally available, the decision 
to adopt CAI should center on individualized goats and requirements, and 
anticipated benefits of CAI. 

For the training organization, the impact of these cost benefits can be 
thought of as being either internal or external to the organization. An external 
cost benefit might be either the reduction of training time or the reduction of 
student attrition. These benefits are external to the organization because they 
impact cost centers other than the training organization. An external cost center 
that would be affected by reduced training time or student attrition would be the 
personnel system. 

Internal cost benefits are associated with the training organization's cost 
of providing training. Maximizing the productivity of instructor personnel, 
reduction of support staff, and increased utilization of facilities are ail examples 
of benefits which are internal to the training organization. Effectiveness in 
achieving such benefits will vary from one instructional approach to another. 
Likewise, the cost will also vary. When the adoption of CAI is being considered, a 
great deal of thought must be given as to how CAI will assist the organization in 
more efficiently achieving its training mission. 

It is stated in the handbook several times that a benefit of CAI is the 
provision of individualized instruction. Other instructional approaches can also 
provide individualized instruction. Instructor tutoring of individual students is one 
example. Another example is programmed text instruction. Before any of these 
approaches can be evaluated for cost effectiveness, there will have to be an 
assessment as to what benefit will accrue to the organization by having 
individualized instruction. 

If it can be determined that individualized instruction will reduce 
student attrition, then this will have a direct cost benefit to the organization. 
Now the question to ask is how to achieve individualized instruction. One way 
would be to provide more individual instructor tutoring. This may be impossible 
without significantly increasing instructor staff—a negative cost consequence. 
This might leave programmed instruction and CAI to consider. Programmed texts 
are limited in their capacity to accommodate individual student abilities} l.e., 
they are nonadaptive. If the student population is generally bright and of the 
same ability level Ce., advanced students), then this limitation of programmed 
text might not be Important. On the other hand, if your student population is 
highly variable in ability, then the adaptlveness of CAI would seem appropriate. 
However, as has also been mentioned, the development of good, adaptive 
instruction for CAI requires personnel with special skills. The availability of such 
personnel might be limited. The cost of acquiring such personnel now has to be 
evaluated against the cost of acquiring additional instructors to provide 
individualized tutoring. In both cases, the negative cost factors associated with 
each alternative have to be compared with their respective cost benefits—in this 
case, the reduction of student attrition. 

In considering potential benefits of CAI, an additional factor to examine 
is the cost implications of having the technology in place with which to develop 
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communication capabilities and the administrative and management functions 
typical of CMI in the future. 

Anyone attempting to approach the adoption decision based on cost 
considerations should recall that many of the costs associated with the 
implementation of a new system are those that would apply equally to an 
upgrading of the present delivery system. Do the data show what the present 
system costs? What are its deficiencies, and what would it cost to make the 
changes necessary to reach the present training goals? 

This discussion of cost implications can be summarized by the following 
algorithm: 

1. Are there objective measures of effectiveness 0^., job 
performance)? 

2. Can training outcomes be correlated with measures of 
effectiveness? 

If either 1 or 2 can be answered affirmatively, then, 

3. Compare instructional approaches based on their impact 
on effectiveness relative to costs. 

If neither 1 nor 2 is possible, 

4. Assess cost benefits for the organization. 

5. Assess cost requirements for alternative instructional 
approaches. 

6. Compare the benefits against the additional cost 
requirements of each alternative approach. 

There is no dear guarantee that CAI will provide substantial cost savings 
associated with instruction. There are indications that there is a number of 
potential cost benefits, depending on the requirements, the system chosen, how 
well it is implemented, and how well the system and the needs are matched. 

When a cost analysis is performed to determine whether CAI is viable for 
a specific training application, the benefits to be expected must be carefully 
described— benefits both to the training organization and to the organizations to 
which a training service will be provided. It is only after the desirod benefits 
have been determined, and how to measure whether those benefits have been 
achieved, that the concept of effectiveness can be addressed. Effectiveness is a 
measure of the degree to which a benefit has been achieved. A benefit can be 
described in terms of either performance or cost. Alternative options are then 
compared on the basis of their ability to positively affect either the performance 
of the product or the efficiency of the process. 
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IU. CRITICAL FACTORS FOR ADOPTING CAI 



A. Use of This Section 



This s*ction it intended to identify specific hardware, software, and 
courseware factors, issues, and considerations in the CAI selection and adoption 
process. Information concerning hardware systems, hardware components, CAI 
development software alternatives, and issues concerning courseware are provided 
in a modular data format. Embedded within the subsections are advantages, 
disadvantages, and tradeoffs for different alternatives, as well as practical 
suggestions for planning and procurement* 

While this section treats critical CAI system issues, there are other 
critical aspects that the user will need to explore in the training environment. 
There are instructional and Institutional factors, issues, and considerations which 
must be addressed through a thorough front-end analysis of a course or courses 
under consideration. 

This section is intended to be used both as a reference tool during the 
decision-aiding process (Section IV) and as a general library tool for obta'ning an 
overview of available CAI options. The use of visual mnemonics for many of the 
data points provides a ready reference to the requirements associated with each 
hardware, software, and courseware component. The visuals are intended to 
provide users with readily visible summarized information relative to other 
alternatives of the same Issue (eg., central, modular, or stand-alone computer 
system configurations). Comparisons of the data points In each are made relative 
to the other alternatives. 

To aid in comparing the visuals for ail alternatives within a hardware, 
software, or courseware category, they are grouped and listed below. 



B. CAI Computer Hardware 



Central Computer Configuration 
Modular Computer Configuration 
Stand-Alone Computer Configuration 



C. CAI Software Support 



1. Higher Order Languages 

2. Authoring Languages 

3. Authoring Systems 
Design Systems 
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D. Courseware 



1* Informational CAI 

2. Drill-and-Practice 

3. Tutorial CAI 
#. Simulation 
5» Inquiry 

6. Intelligent CAI 



Whenever possible, comparative information for several component 
alternatives has been placed on the same page. 

5^*1° COft J d * tl included, especially in the hardware 

section. The prices and price ranges are likely to change rapidly, but are accurate 

refl cted qUartCr 0f 1983, Large P urch ** e P^lce breaks are, naturally, not 
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B. CA1 Computer Hardware 



1. Central Computer Configuration 



Section Technical Vocabulary 2 

processing "dumb 1 * terminal 

time-shared (sharing) microprocessor 

mainframe multiplexer 

minicomputer downtime 



In this type of configuration, as shown in Figure ffi-1, all CAI capabilities 
are accessed from a central computer facility containing all of the processing and 
memory storage capacity of the system. All CAI terminals are connected to the 
central computer and share the use of this computer and the CAI programs stored 
within it. Because of the allocation of processing time, through a special program 
in the computer, centralised computer systems are often referred to as time- 
shared systems. The computer in a centralized system tends to be either a 
mainframe computer or a minicomputer (see 4.1.1 and ft.1.2 in this section), but 
can also be one of the newer, powerful microprocessor-based mainframes (see 
4.1.3). The CAI terminals in a centralized system are often referred to as "dumb" 
terminals because they have no capacity to process information without being 
connected to the central computer. The fuU-capability PLATO system is an 
example of a large, centralized CAI development and delivery system that is 
hosted on a mainframe computer. Such a system can be purchased or 
development and delivery services can be leased through national networks. The 
TICCIT (Time-Shared, Interactive, Computer-Controlled, Inf ormatic •» Televlsioft) 
system is an example of a minicomputer-based, centralized CAI system. By way 
of contrast, a PLATO system can time-share up to about 1,000 terminals; a single 
TICCIT system can time-share up to 128 terminals in close physical proximity. 



Advantages 

The major advantage of a centralized system configuration is that a 
powerful computer with a large memory capacity can be shared by many users. In 
a centralized system, a single copy of a program can be shared by all users. If the 
centralized CAI system collects student data, then these data are usually 
available immediately to instructors or training managers monitoring the system. 
Archiving functions and the overall management of software-based instructional 
materials G.e., courseware) are simplified with a single location for processing. A 
centralized system can also provide a means of easy communication between 



2 See Glossary, Section V.B. 
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Figure III.l. Central time-shared CAI system configuration 
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users through a message or "mailbox" feature. Because centralized configurations 
have been available for the longest time of any configuration, extensive support 
features, services, and experiences are available to users. 



Disadvantages 

The major disadvantage of a centralized system is its lack of local 
control. All users of the system are totally dependent on the operations of the 
central computer fac'lity. If the central computer system becomes inoperable, 
then all CAI will stop. Generally speaking, programs that exist on the central 
computer are designed to be useful to the maximum number of users. The 
complexity of processing activities in a central computer system is high because 
many different programs can potentially be run simultaneously. The number of 
users on a central system affects the responsiveness (called response latency) o! 
the system to a single user* The provision of specialized programs for local use 
may be limited, especially if the number of specialized programs becomes large 
enough to require sizeable increases in memory storage (see 4.2). 

1.1. Cost Requirements. There are three ways in which to acquire this 
type of CAI capability: purchase a computer system for CAI use solely, lease CAI 
capability from a network, or adapt an existing computer capability currently 
used for non-CAl tasks such as data processing. Because the third option is so 
variable, it will be excluded from discussion. With a central computer 
configuration, the cost is weighted toward communications, especially for leasing 
services, and toward communications plus purchase price if a centralized system 
is being procured. Communications are important cost factors especially if 
terminals are physically remote from the central facility, because of the 
recurring cost of dedicated telephone lines. These costs can be quite high, 
depending on location and on multiplexing capabilities. When centralized systems 
are purchased, operational and maintenance costs are generally high because of 
the need to ensure that downtime of the computer is minimized. 

1.2. Staffing Requirements. A purchased centralized CAI system 
configuration usually requires a substantial administrative and system 
programming staff to coordinate user needs and to provide maintenance of system 
programs. 

A leased/ licensed centralized configuration usually requires some 
administrative coordination but generally does not require maintenance or system 
programmers. 

Both purchased and leased/ licensed systems will require courseware 
development staff members if CAI is developed in- ho use. The exact staff 
descriptions depend on software tools available (see Section HI.C). 

1.3. Facility Requirements. A purchased centralized CAI system 
configuration is used when it is logistically feasible for a fairly large number of 
users to share a common set of hardware, software, and courseware resources. As 
a consequence, a centralized system typically requires a central computer facility 
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for the central processor and its related memory storage equipment. Depending 
on the type of computer processor (see Section IH.B.*), this central facility can 
require special environmental supports such as air conditioning and increased 
po*wcepacity. A centralized system is particularly vulnerable to power outages 
because if the central c o mpu ssi g ee s down, all CAf ceases. For this reason???* 
facUity for a central system typically has a redundant emergency power system. 
With a centralized system, as the system grows, the special facilities also have to 
increase. Such facility expansion can be costly. Lack of sufficient space to grow 
can limit the increased use of a centralized system. 

A leased networked, centralized configuration, such as PLATO, requires 
telecommunication and normal office or classroom-style facilities. Lighting and 
adequate electrical outlets are the only special facility requirements. 

i.». Organizational Requirement*. In a centralized CAI system, changes 
"jade to software or courseware can potentially affect all users of the system. 
Organizationally, a centralized system requires a strong configuration 
management capability to ensure that all software and courseware changes are 
properly justified, documented, and authorized before being made. It is 
imperative that one local user cannot make changes which inadvertently cause 
problems for other users of the system. The ability to accommodate the special 
needs of local users requires that the design of the system configuration be 
carefully considered during the adoption and planning period for a CAI system. 

1.3. Procurement. Because in a centralized system the hardware and 
software resources are shared by all users, care has to be taken prior to 
procurement to ensure that the needs of all potential users are carefully assessed. 
Adaptation of a centralized system to local user requirements after the initial 
system procurement can be very costly, if not impossible. Also, because a 
centralized system is usually justified on the basis of a large number of users, the 
initially procured hardware should generally meet the expected maximum 
capacity of the total system. This particularly impacts the facility requirements. 
This means that for a centralized system, the procurement process should take 
into account a large initial capital investment. For commercially available 
central CAI systems, the leasing of access time rather than outright purchase 
should also be considered. 
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B. CA1 Computer Hardware 

1. Central Computer Configuration 4 

Purchased Leased/Licensed 

1. Purchase or start-up costs 
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a As in ail subsequent figures, the requirements shown above are relative 
to ail other alternatives for this heeding. 
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B. CA1 Computer Hardware 
2. Modula r Computer System Configuration 



Section Technical Vocabulary 3 

processor^) main memory 

central processor disk drive 

"dumb" terminal operating system 

fiie management capability upward compatible 

byte downtime 

/ , configuration control/management 

multitasking (computer) operating downloaded 
system 



A modular computer system configuration is illustrated in Figure III-2. 

♦vn^rl J 1' the term refers 10 the capability of a single processor 

type fe.g., a microcomputer) to be configured either as a stand-alone computer or 
a central computer. A modular computer system configuration is one in which 
there is a central processor to which several "dumb" te.mlnais are connected 
under a multitasking, multiuser operating system and additionally, to which also 
are connected several independent computer processors. The independent 
processors can be configured either as stand-alone devices or as time-shared 
systems controlling their own set of dumb terminals. An important guideline to 
remember is that at ail levels of the modular computer system configuration, the 
same computer processor should be used; however, at each level the type and 
quantity of memory storage will vary. If the same processor is not used at each 
i««?L W 1 ? ^ m ° dUlar system configuration, then care should be taken to 
ensure that all processors used are software compatible G.e., the same program 
will run on all processors without having to be modified). program 

As an example, in Figure IH-2, the processor used as a central controlling 
and file management capability might have 1 million bytes (1 megabyte) of main 
memory and 40 megabytes of hard disk memory storage. This central processor 
would also have an operating system that would allow several terminals or 
processors u t0 time-share it* stored programs and files. The 
ndependent processors that connect to the central processor would typically have 
less main memory (e.g., 256 kilobytes) and a smaller amount of disk storage , fc!g ! 

^ r^r independent processors are capable of running CAI courseware 
Z^L^l"* connected ^ the central processor. However, periodically the 
independent processors would interact with the central processor for the purpose 
of exchanging information or to retrieve new CA! courseware. Each independent 

3 See Glossary, Section V.B. 
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processor can function as a single-user capability and could also drive a limited 
number of dumb terminals u.e., 2 to 8) . 



* n e »mpie of a commercially available, modular type system is the 
W1CAT Computer-Based Instructional System. In the WICAT system, there are 
two processor levels. The first is a System 200 which serves as a central 
processor and the second is the System 160 which serves as an independent, desk- 
top computer. Both the System 200 and System 160 are based on the same 
microcomputer processor. 



Advantages 

s* si wJ, he ma * or advanta *e of a modularly configured CAI system comes from 
its flexibility. In a properly designed modular system, the CAI software is upward 
compatible, making it possible to adopt CAI on a limited basis using "desk- top" 
versions of the system's computer. As need and/or interest increases, the system 
can be expanded to include a central processor that will permit several users or 
groups of users to share a common set of courseware, and it can also provide for 
central data collection. Because of the upward compatibility of the courseware 
material developed on or running on the independent processors, this courseware 
can later be uploaded to the larger central computer. This type of flexibility 
permits an evolutionary type of growth in CAI application. 

» 

Another advantage of the modular system is that the downtime of one 
processor in the system does not affect other users on different processors. Also, 
response latency is not degraded as in a centralized CPU. 



Disadvantages 

A disadvantage of a modular-type system is that the redundancy of 
computing power between a central processor and several independent processors 
can be more costly than a comparable centrally configured system. However, the 
lower maintenance costs of a modular system could easily offset a higher 
equipment cost. If analysis shows that the initial CAI application can support a 
large number of students in a single geographic location, then the user should 
carefully weigh the costs of a central system versus a fully modular system 
supporting the same number of students. 

Configuration control can be a problem with a modular-type system. 
Users of an independent processor could download a lesson from the central unit 
and then make modifications to it. After a period of time, standardized materials 
could become dramatically changed and be quite different among the independent 
nodes within the system. Another consideration associated with configuration 
control in a modular system is that associated with courseware development. If 
courseware development occurs on a central unit in the modular system, care has 
to be taken to ensure that the developed program is "sized" correctly so as to be 
able to be downloaded to a smaller delivery unit within the system. 
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2.1. Cost Retirements. The major cost factor In the modular system is 
associated with the redundancy if processing capacity. Independent processors 
should be used when reeerriitg communication coats from featured and remote 
users to a central system will be excessive or when special processing 
applications, such as simulation programs, place a heavy burden on the processing 
capacity of the central unit. 

A modular system can allow the separation of development costs from 
delivery costs. A more powerful version of the basic computer can be used as a 
central development system while smaller, less sophisticated, and more numerous 
versions of the basic computer can be used for delivery. If a modular system has 
specialized CAI software, the purchase or licensing costs for that software needs 
to be carefully assessed. A separate software license for each processor in the 
system may be required. 

Maintenance costs for a modular system are generally less than for a 
central, mainframe system. 

2.2. Staffing Requirements. Typically, a modular system will require 
less staffing than will a large central CAI system. The hardware is usually less 
complex than for the large central system and thus requires a smaller 
maintenance staff. In a modular system where there is a central "development" 
site networked to several independent delivery sites, the development site will 
require a formal staff of system and application programmers (the latter would be 
replaced by instructional developers using an authoring language or authoring 
system). Administrative staff is project dependent, with variables including the 
size of the project, whether or not development is centralized, etc. 

2.3. Facility Requirements. The hardware of modular-type systems 
involves either minicomputers or microcomputers. As a consequence, there is 
normally no need for special facilities to house the system hardware beyond what 
is generally required for security, comfort, and accessibility. 

7 A. Organizational Requirements . With a modular-type system there 
are two organizational options. Tne first option is to separate development 
functions from delivery functions. With this option, an organizational unit 
responsible for development of courseware and other programs would be 
established. Delivery of CAI would be the responsibility of the user group and 
would be organizationally separate from a development unit. The second option 
would be for each local user to support both development and delivery, using the 
central facility simply as a communication device and a means of sharing 
courseware resources with other local users, and to accommodate central storage 
of common data. 

2.3. Procurement. In situations where it may be difficult to allocate a 
large amount of money at one time for CAI, a modular system can allow a small 
initial procurement without limiting the ability to expand into a larger CAI 
system at some future time. However, the license costs for the CAI software 
may be the same for the smaller unit as for the larger unit in the modular system. 
Thus, if you start off with a small configuration, you could easily find yourself 
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paying more for the software than the hardware. In your procurement process, 
you should plan accor<fingly for the difference in cost between software and 
£roW. Also, price breaks of ten occur as the result of quantity purchases in 
both hardware and software; thus, quantity purchasing should be explored. 
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ft. CAI Computer Hardware 
2. Modular Computer Sy«t«m Configuration 
1. Purchase or start-up costs 
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B. CAI Computer Hardware 
3. Standal one Computer System Configuration 



Section Technical Vocabulary* 

main memory processing time 

] a f d J?* external storage 

**** °*ses time-share 

main memory operating system 



i tk * stam»-*lone computer system configuration is illustrated in Figure ID- 
in JJ? S^f^™ COmputer *?? tem ij distinguished from a modular- type system 
to that the basic computer used is designed solely to be a single-user c^DUter. 

C ° mpUtCr mlt ta . ,h " ^^type system can function eilto as a 
single-user computer or a multiuser, multitasking computer. 

. . ™ e ftand-alone system configuration is based on a collection of 

independent microcomputers. The microcomputers can be networked together to 
snare common memory storage units such as a hard disk drive. Such a network of 
^° C ?. mP n« er T T * ^Suished from a central, time-shared system in that 
»^Lj1. <S i n ^ C « operatin « *> rstem software governing the availability of 
Ti" 1 ' main "!f mory * and externai storage. Each microcomputer in the 
i J?^ wn complete system. Each unit in the stand-alone network has to 
if »Jiir5i Wn |f ete J!l t ? "P"*** software. However, the network feature, 
SETS' ? < 2* Shtring °* CAI P™*™™ <* data bases. Of late, several 
ow£ nl?5*£!l m i ain r *7 e * miflicom P uter equipment have begun selling their 
own line of stand-alone microcomputers, which presently have or are expected to 

su^StlS! T featUre$ that wiU aUow them to ^te either stand! 

m ,5^ ? vI ne ^ t0 their larger mainframe or minicomputers. These capabilities 
wiU allow implementation of a full range of system configurations. capaDumes 

. . , UL So ? e sta,ia j*jone microcomputers can be networked together to share a 
hard disk storage device. Some use a CAI capability based on an authoring 
language (see Section HLC.2) similar to that used by the PLATO System. 8 

Advantages 

The main advantage of a stand-alone CAI system is that it provides the 
owest entry-level cost for hardware when the number of users is to £ relatively 
low. A second advantage of the stand-alone system is that it can usually be 



♦See Glossary, Section V.B. 
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Figure III. 3, Stand-alone, local network CAI systea configuration, 
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adapted to provide unique dedicated instruction such as might be needed In the 
context of « special training device or peripheral. For both mason*, the stand- 
alone mWcomputer is en excellent introductory tool for • small CAI 
demonstration. 



Disadvantages 

The capacity of the stand-alone system in terms of available main 
memory is often much less than that available in either a modular system or a 
lar|e central system. Generally speaking, stand-alone systems bated on popular, 
personal microcomputers lack the capacity to run vary complex CAI programs nor 
can they be converted into CMI systems at a later date. For the instruction of 
large numbers of students in a single geographic or physical location, the 
redundancy of processing capacity, main memory, and operating software can be 
more costly than for modular or central systems* 

Stand-alone systems dc not, as a rule, offer the software tools that are 
available on either a central or a modular-type system. The lack of specialized 
CAI software development and revision tools is a function of memory and storage 
limitations in the stand-alone systems. Thus, courseware development can be 
more difficult and time-consuming with stand-alone systems. 

M 3.1. Cost Requirements. The initial cost of the stand-alone system is 
PUSw I lowest of the three system configurations discussed in this 
handbook. However, not only short-term costs but long-term costs must be 
carefully considered. If a few stand-alone systems are acquired first, will these 
have to be expanded to support a larger number of students in the future? if so, 
what will the cost be using stand-alone equipment? If a larger system will be 
required in the near future, can the courseware developed for the stand-alone 
system be easily transferred to the larger system? If the stand-alone systems are 
adequate for immediate and future instructional needs, then the next cost 
consideration is whether a network capability is needed and whether moving to a 
CMI system is anticipated. In general, if there are 5 to 10 users, it is less 
expensive to have a network sharing common external storage. 

aMi — Staffing Requirements. Stand-alone systems require minimum 
staffing i or operation and maintenance. Stand-alone CAI systems are usually 
designed to be operated by the regular instructional staff. Staffing for CAI 
development is dependent upon available CAI development and revision tools. 

. M1 . 3.3. Facility Requirements. Stand-alone systems do not require special 
facilities. They are designed to operate in a normal classroom environment. 

... 3 '?1 Organizational Reoutram«m<. in general, stand-alone CAI systems 
will nave the minimum impact on your existing organizational structure relative 
to other configurations. However, the ease with which these systems can be used 
may be misleading. If Instruction is meant to be standardized, organizational 
mechanisms will be needed to ensure proper configuration management of the 
courseware and other application software. Stand-alone systems allow local users 
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to make changes to lessons easily? however, such changes affect only the local 
user* 

3.3. Procurement. The typical low cost of stand-alone systems allows 
them to be purchased quite easily. However, caution needs to be exercised so 
that, over a period of time, different groups within an organization have not 
purchased a variety of incompatible systems which preclude future sharing of 
courseware resources or development skills when a later level of CAI usage 
warrants it. 
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B. CAI Computer Hardware 
3. Stand-A lone Computer System Configuration 
1. Purchase or start-up costs 
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CA1 Computer Hardware 



a. Hardware Components 

Tht computer sytttm configurations discussed In Sectlor- UI.B.1, HI.B.2, 
and IU.B.3 ill consist of four hardware componantst 

1. Tht computer processor. 

2. Extsmal memory and storage devices. 

3. Types of CAI terminals. 
*. Communication system. 

For any particular classification of hardware components, there is not 
necessarily a unique match between hardware type and a particular system 
configuration. For example, a central system configuration can have as its 
central computer a mainframe computer, a minicomputer, or a microcomputer. 
In assessing the level of hardware needed for a proposed CAI capability, each 
hardware component has to be given individual consideration apart from how It Is 
configured in total. 
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B. CA1 Computer Hardware 



4. Hardware Components 

ftgig Processor Size. 



Section Technical Vocabulary 5 



processor 
bit 

"word" 
time-share 



The main component of a CAI system is the computer processor. 
Computer processors have come to be classified into three general types: 
mainfran.es, minicomputers, and microcomputers. These three classifications in 
the past have generally corresponded to the size of the computer processor. Size 
is measured by how much information, designated in bits, that the computer could 
process at one instant in time. This size designation in terms of bits of 
information is known as "word 1 length of the processor. Thus, a 32-bit word 
characterized a mainframe computer processor, a 16-bit word characterized a 
minicomputer processor, and an 3- or 4- bit word characterized a microcomputer 
processor. However, with the extremely rapid development of microprocessor 
technology, word length is no longer particularly accurate in distinguishing one 
level of computer processor from another. There are now microcomputers with 
processors that have 16-bit words as well as 8-bit words. The designation of size 
has to be made on a variety of factors} across manufacturers there will be an 
overlap in the use of the terms mainframe, minicomputer, and microcomputer. 
For the purposes of this handbook, the primary factor of tfstinction will be the 
number of users easily supported by a single computer processor. 

♦.1.1. Mainframe. The term mainframe computer refers typically to a 
large, multipurpose computer. Mainframe computers are used where heavy 
processing activities are required on a time-shared basis. Mainframe computers 
tend to be used where the number of users exceeds 100. 

4.1.1.1. Cost Requirements. Mainframe computers tend to be costly. 
The average price range is between $150,000 and $5,000,000. 

4.1.1.2. Staffing Requirements. Mainframe computers require a fairly 
large staff of system programmers and computer operators for their proper 
operation and maintenance. 



*See Glossary, Section V.B. 
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4.1.1.3. Facility Requirements. Mainframe computers normally require 
special faculties to maintain a proper environment for their operation. These 
facilities usually need to be air conditioned and wired to handle large electrical 
loads. Because of the large number of users on a mainframe at one time, tne 
facilities usually include a back-up power supply system. 

4.1.1.4. Support Capacity. Mainframe computers have the capacity to 
support a large number of users operating different programs at the same time. 
For CAI use, this means that one computer can be expected to support many 
courses at one time. A large mainframe computer can potentially support the 
entire CA1 operations of a single training organization such as a training school or 
group. 

4.1.2. Minicomputer. A minicomputer is a computer which has 
sufficient power to handle between 20 and 50 users. Some manufacturers sell 
what they consider a minicomputer that can handle more than 50 users? some, as 
high as 128 users. However, on the average, a minicomputer is a medium range 

m ne# 4.1.2.1. Cost Requirements. The average cost for a minicomputer is 
between $20,000 and $200,000. 

4.1.2.2. Staffing Requirements. Because of their smaller size, 
minicomputers typically do not require the level of maintenance that a m*nt rame 
computer does. Minicomputers usually do not require a staff of computer 
operators. Tor most minicomputer operations, one or two individuals can serve 
both as system programmer and system operator. 

4.1.2.3. Facility Requirements. Minicomputers normally do not require 
special environmental conditions; however, they can be large enough that special 
electrical power requirements are needed. Minicomputers wM put out a fair 
amount of heat, but normal room air conditioning is usually sufficient to offset 
this heat production. 

4.1.2.4. Support Capacity. Minicomputers used for CAI can support 
several students working on different lessons at one time. However, If some of 
the lessons are processing-intensive such as is the case with nstructional 
simulation, then other users may be affected. For special aPpUc»tlons of CAI, 
such as intelligent CAI, a minicomputer which can normally hand ie * j£* nt « 
would be able to handle only 2 to 4 students. For CAI applications, a 
minicomputer would usually be limited to supporting a single large course or 
several smaller courses. A minicomputer could support the CAI operations of a 
training branch. 

4.1.3. Microcomputer. A microcomputer is typically small in size and is 
the type of computer which is often referred to as a personal computer or a desk- 
top computer. However, microcomputers can also come n j)o^-ty^ cabinets 
and be as large as some minicomputers. A microcomputer is distinguisned by the 
^t that its processing unit is in the form of a single electronic chip. 
Microcomputers are often designed for the single user, but ^^|crocj^puters 
can handle as many as 16 user terminals. Generally, a microcomputer is best 
suited for five or fewer users. 



60 

71 



4.1.3.1. Cost Requirements. Microcomputers are relatively low cost 
devices. The price range for units useful for CA! is from $150 to $10,000. 



#.1.3.2. Staffing Requirements. The average microcomputer has been 
designed to be operated by personnel without special computer training; however, 
for microcomputers which can support several users or for several, single-use 
microcomputers connected together into a communication network, it would be 
advisable to have a$ least one person who is a knowledgeable computer 
programmer. 

4.1.3.3. Facility Requirements. Microcomputers require no special 
f acuities. They can be easily operated in a normal classroom or office 
environment. 



4.1.3.4. Support Capacity. Most available microcomputers for CAI are 
meant to support a single user taking a single lesson at a time. Some of the larger 
and newer microcomputers can support several students taking different lessons 
at the same time. These larger microcomputers can handle the CAI requirements 
of a single course or in some cases a training branch. Smaller microcomputers are 
best for the support of individual units within a course. 
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ft. CA1 Computer Hardware 

». Hardware Components 
Processor Size 
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B. CA1 Computer Hardware 



♦. Hardware Component* 



♦.2. Memory Storage. 



Section Technical Vocabulary 



central memory 

read only memory (ROM) 

random access memory (RAM) 

external memory 

memory chip 

megabyte 



data files 
hard disk 
floppy disk 
kilobyte 



byte 
bit 



There are two classes of computer memory. Internal or central memory 
is that which is resident within the computer. External memory is that which 
resides outside of the computer. External memory itself can be classified into 
three distinct types: hard disk, floppy disk, and cartridge. All memory capacity 
is indicated in bytes of data or Information which It can store. One byte is 
equivalent to S bits of information or a single alphanumeric character. 

♦.2.1. Central Memory. Central memory is hardware-based memory 
that is usually designated by the terms ROM (read only memory) and RAM 
(random access memory). ROM is memory which, once it has been created, 
cannot be changed. It is used to store permanent programs usually supplied by the 
manufacturer of the computer. RAM is memory that can be used to store 
programs temporarily while they are being processed by the computer. Most 
central memory is of the RAM type. Central memory should be contrasted to 
external memory, which is that memory storage capacity which resides outside of 
the computer itself. 

♦•2.1.1. Cost Requirements. Of all memory, central memory is the most 
expensive On oart because it is provided by memory chip hardware). For one line 
of popular minicomputers, a megabyte of central memory is approximately 
$9,000. This is $.009 per byte. 

♦.2.1.2. Support Capacity. The amount of central memory required is 
directly proportional to the number of users that the CAI system is to support and 
to the number of different programs that will be run at any single time. The type 
of CAI software that is available will make a big difference in the amount of 
central memory that is needed. If each CAI lesson is a self-contained program, 
then sufficient central memory will be needed to store each lesson so that it can 
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be processed in real time by the computer. An alternative is to have a CAI 
delivery program that operates on lesson data files. In this case, the delivery 
progam pulls in from external memory only that portion of a lesson which is 
needed atone time. The amount of central memory needed is that which provides 
for the delivery program and a certain amount of central memory "work space" 
for each user. Determining the amount of central memory that is needed is 
referred to as sizing a computer system. 

4.2^. Hard Disk. Hard disk is a form of external memory which 
provides for very rapid access of data. It consists of a stack of magnetic disks 
and pickup arms over each disk in the stack. The concept of a hard disk is like the 
record and the stylus arm of a phonograph. A hard disk is a stable storage 
environment and information on it is randomly accessible. Hard disks offer large 
amounts of relatively cheap memory storage. Most hard disks are integral to the 
device that reads them? however, there are some hard disk units which have 
removable disk units* For microcomputers and minicomputers there are typically 
two sizes of hard disk— 5K" and 8"— usually referred to as "Winchester type" disk 
drive. Large mainframe computers use larger type drives. 

4.2.2.1. Cost Requirements. Small hard disk units typically used with 
microcomputers and small minicomputers average $2,000 to $5,000. Larger hard 
disk units associated with large minicomputers and mainframe computers average 
$8,000 to $20,000. For a popular series of minicomputer, a 28 -megabyte hard disk 
with removable disk cartridge is $13,000. The memory cost per byte is $.00046. 
A 5 -megabyte hard disk used with popular microcomputers costs approximately 
$3,800, or $.0008 per byte. As can been seen, there is a savings in buying larger 
increments of memory capacity. 

4.2.2.2. Support Capacity. The capacity of smaller hard disk units (5K") 
generally is available in increments of 5 megabytes up to a total of about 20 
megabytes. Larger hard disk units (8") usually range from 40 megabytes to 160 
megabytes. Hard disk units used with mainframe computers are usually 14" drives 
and can store as much as 1,800 megabytes of data. Assuming that one page of 
printed, single-space text is 4,752 characters (66 lines x 72 characters per line), 
then a 5 -megabyte disk would hold 1,042 pages of printed text information. A 
160-megabyte disk would hold 33,670 pages of printed information. 

4.2^. Floppy Disk. A floppy disk is a flexible, plastic, external memory 
storage device. Floppy disks come in two basic sizes— 5 K" and 8". Unlike hard 
disks, the floppy disk is always separate from the mechanical drive that reads it. 
Floppy disks containing CAI courseware can be physically stored in cabinets, 
notebooks, etc. until they are needed. Floppy disks are physically handled during 
use; therefore, they are more subject to damage than are hard disks. Generally 
the life expectancy (the number of times they can be read before losing data) of 
floppy disks is less than that of hard disks. Floppy disks, like hard disks, can be 
both read and written to, and the data on them are randomly accessible. Floppy 
disks are usually limited to use with microcomputers and small minicomputers. 

4.2.3.1. Cost Requirements. The cost of floppy disks is relatively low. 
The disks themselves cost an average of $3 to $8 each. The disk drives for the 
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5K M disk average about $300 whereas 8" drives average about $900. For a popular 
personal microcomputer, the floppy disk drive costs $395 with a storage capacity 
of 1*0,000 bytes. This is a cost of $.003 per byte. 

♦.2.3.2. Support Capacity. Floppy disks which are 5*" in size can store 
anywhere from 83 kilobytes to 1 megabyte. However, 5K" drives used with 
personal-type microcomputers tend to have a capacity of 140 to 170 kilobytes of 
storage. This level of storage would hold 29 to 36 pages of printed text 
information. Eight-inch floppy disks typically store 256 kilobytes to 4 megabytes 
of data. This means a capacity of 54 to 842 pages of printed text information. 
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B. CAI Computer Hardware 



»» Hardware Components 

».3. CAI Terminals. 



Section Technical Vocabulary 7 

CRT intelligent terminal 

flat panel "dumb" terminal 

selective erase 
RGB time-share 
P ixels terminal driver 

There are several types of terminals which can be used for the 
presentation of CAI lessons. Stand-alone microcomputers that are classified as 
"personal" or "desk-top" units are really a computer and terminal in one package. 
For these types of computers, the terminal component is primarily the video 
display unit (or screen). For CAI systems based on minicomputer, mainframe, or 
larger microcomputers, separate, individual terminals have to be used to present 
CAI courseware. For purposes of delivering CAI, some level of graphics 
capability in the terminal is necessary. Graphic terminals can be classified by the 
type of display they use. One display type is based on the use of a cathode-ray 
tube (CRT). The other type is based on the use of flat panel technology which 
uses fluorescence, plasma, or electroluminescence to create an image rather than 
an electron beam and phosphor as in a CRT. 

#.3.1. Video Display Unite. The video display unit is used with stand- 
alone, single-user microcomputers for which a separate computer terminal is not 
required. The video display unit can be of two types~a normal black-and-white 
or color television or a video monitor. If the display unit is a monitor, the input 
from the computer goes directly t-» the video amplifier of the CRT without having 
to go through a radio frequency <RF) section, as is the case with a normal TV set. 
For this reason a monitor provides a crisper display than a TV. 

There are two types of video inputs to a video display unit from the 
microcomputer. The first kind is a composite video input} for color-type displays 
this means that the three prime colors (rtd, green, and blue) components of a 
display are combined into a single input signal. The other type of video input to 
the video display unit is referred to as Red, Green, Blue (RGB), which means that 
the prime color components are input separately to the video amplifier of a video 
monitor. TV-type display units can have only a composite video input. RGB input 
provides better color display capability than does composite video input? however, 
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if the same monitor is to be used for both computer displays and normal video 
displays, then a composite input is needed. 

M.U. Coat Requirements. The coat of a yideo eUspUy unit is 
equivalent to that of a good television set. The average use for CAI wlfl require a 
'^olaSnal picture tie. Whether the unit Is a regular TV or a composite video 
monitor, the price will be approximately $350 for color. For an RGB-type 
monitor, the average price will be about $800. 

0.3.1.2. Support Capacity. The resolution of a TV-type display unit is 
approximately 192 by 256 pixels. The first number is the resolution in the vertica 
dimension while the second number Indicates the resolution in the horizontal 
dimension. A pixel Is a discrete point of illumination on the screen. The greater 
the number of pixels, the greater the resolution. The average number of text 
characters that can be displayed by a TV-type monitor is 960. An RGB-type 
monitor will have a typical resolution of approximately 2*0 x 560 and will be able 
to display 1920 text characters. 

a.3,2- CRT Graphic Terminals. A CRT graphic terminal is used with 
computers that do not fall within the category of "personal" computers. A CRT 
graphic terminal is a self-contained unit with both keyboard and display. There 
are two ways to classify CRT graphic terminals. One way is on the basis of 
whether the terminal can support, on its own, any of the processing associated 
with a graphic image. If the terminal does support some of the image Processing, 
then it is classified as an "intelligent? terminal. If it does not, then it is a "dumb" 
terminal. 

The other way CRT graphic terminals can be classified is on the basis of 
how they produce a graphic image. One way an image is produced is called 
"raster scan." This is the method used by a television set to produce an image. 
Another method of image production is called "storage tube." In a storage tube- 
type terminal, the electron beam is controlled so that it literally "paints" the 
image on the screen as if one were using a pen. Additionally, once the image is 
drawn in a storage tube-type terminal, the image tends to remain in view rather 
than immediately disappearing and thus having to be redrawn. In the raster scan 
terminal, the electron beam simply scans back and forth, top to bottom, turning 
pixels on and off as it moves back and forth. The image produced by a raster scan 
terminal has to be constantly redrawn or refreshed. A storage tube display will 
draw complex curves very precisely but slowly. A raster scan display will draw a 
curved image very quickly but it will be more jagged in appearance. Finally, a 
third type of graphic display capability is called "vector refresh." It draws an 
image ona point-to-point vector basis like a storage tube device, but the image is 
constantly refreshed as in a raster scan display. A vector refresh device can 
provide a precise image fairly quickly. Most vector refresh graphic terminals lack 
color capabilities. 

0.3.2,1. Cost Requirements. The average price for "dumb" terminals is 
approximately $1,000. Intelligent- type graphic terminals average $2,500 to 
$3,500 with high resolution, with special function terminals being as high as 
$10,000 to $15,000. Storage tube-type CRT terminals are generally less 
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expensive than raster scan- type terminals. However, the maintenance and 
replacement costs for storage tube-type terminals are higher than for raster 
scan- type terminals. Except for TV -quality raster scan displays, the cost of 
raster scan and vector refresh displays Is higher for a high-resolution capability 
because they need more complex refresh circuits. 

4.3.2.2. Support Capacity. Two things should be considered in selecting 
a terminal for a CAI application. The first is the resolution of the image, and the 
second is the speed with which a complex image can be produced. Relatively 
Inexpensive raster scan- type terminals are good in CAI applications where text is 
used primarily and the graphic images are not overly complex. Also raster scan 
provides good quality color and brightness. In areas of CAI, such as simulation 
where good resolution of equipment components or schematics is needed, the 
vector- based drawing of a storage tube or vector refresh device is better than the 
point-by-point or character graphics addressing of a raster scan device. 

Where speed is important, such as in frequently changing graphic 
displays, or where the part of the display is being selectively erased and new 
information is being presented, a raster scan device is a good choice, as long as 
the graphics are not too complex. The speed with which a graphic terminal will 
draw a new display is dependent on whether the terminal has any "intelligence." 
In a time-shared system, the terminal driver (software which controls what the 
terminal will do) can control the creation of a display. However, this is usually 
slower than if control data are sent to an intelligent terminal which itself has an 
internal program that produces the display image. The tradeoff is cne of cost 
versus speed. 

♦.3.3. Plat Panel Display Terminals. A flat panel display consists of two 
panels of glass which have sandwiched between them a grid of conductors and an 
inert gas. When an electrical charge is placed at a point in the conductor grid, 
the gas is caused to glow, producing a point of illumination. The most notable 
aspect of flat panel displays is their compactness. Additionally, flat panel 
displays are very rugged compared to CRTs. The PLATO system previously used a 
plasma panel display as its primary terminal. Lately, CRT-type terminals are 
being more frequently used with PLATO. Fiat panel displays are limited to being 
monochromatic. In addition to a plasma panel, a flat panel type which is 
appearing more and more in handheld or portable computers is the liquid crystal 
display (LCD). Although handheld devices have not typically been used for CAI, 
they do have the potential for use, especially as low-cost drili-and-practice or 
testing devices. 

0.3.3.1. Cost Requirements. The cost of flat panel technology is 
generally expensive. The flat panel Itself, apart from the rest of the terminal 
hardware, is typically 8 to 10 times more expensive than is a CRT with 
comparable resolution. A CRT by itself may cost $100 whereas a comparable flat 
panel costs $2,500. LCDs are inexpensive because they are kept small in size and 
are mass produced. A typical handheld computer is $250 to 400. 

4.3.3.2. Support Capacity. The plasma-type flat panel display and 
terminal typically provide a resolution of 512 x 512 pixels. In the PLATO system 
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this produces a text display of 2,04$ characters. Also, with a plasma display it is 
possible to display various sizes and types of characters as well as rotate 
characters. Very small characters maintain their readability. One reason the 
early PLATO system used a plasma-type display was that it easily maintains a 
display image. In other words, the display has its own memory and does not have 
to tie up computer memory to maintain the representation of an image. An 
intelligent CRT -type terminal accomplishes the same thing by having its own 
display and computer memory. A reduction in computer memory chip prices 
reduced the memory advantage of the plasma panel. Another advantage of the 
plasma display which was seen as being useful was that a film-based image could 
be projected onto it from the rear. This allowed high- resolution film images to be 
used with computer graphics. Liquid crystal displays, as they appear in handheld 
devices, provide only limited displays of either text or character graphics. The 
size of the typical LCD is one to four lines of 40 characters. An LCD can be used 
as a "window" onto a larger body of text through scrolling both right and left as 
well as up and down. 

4.3.4. Other Terminal Features. In addition to the type and the 
resolution of the display chosen, consideration has to be given also to the input 
feature of a terminal. The most common input mode is the keyboard. However, 
keyboards can range from simple typewriter-style layouts to more complex 
configurations, which include separate numerical keypads or special function keys. 

For CAI, the availability of function keys can be very important to the 
support of certain instructional strategies. For those approaches which allow 
learner access to specialized information, it is desirable that this information be 
accessed with a single key stroke. 

Other terminal input modes which should be considered include touch 
panels or light pens, which can allow a student to respond by simply pointing to a 
screen location. It is desirable that terminals used in support of CAI allow access 
to such alternative input modes. On lower cost microcomputers, it is often the 
case that the game I/O port can be used with a joystick or a "mouse" to move a 
cursor around in order to allow the student to indicate a response. 



70 

81 



Si CAI Computer Hardware 

». Hardware Component! 
*.3. CAI Terminals 



#3.1. Video Display Units 
1* Coat Requirements 



////////////////// 


low 


high 


2. Support Capacity 




////////////////// 



low high 
CRT Graphic Terminals 

1. Cost Requirements 

(dumb terminal) 



////////////////// 


low 


high 


(intelligent terminal) 




IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIHIIIIIIIIIIIIIIII 


low 


high 



2. Support Capacity 

(raster scan) 



///////////////////// 


low 


high 


(storage tube/vector refresh) 




niinilWIUIIIIUIItlMIMItNltltllMIUHmtWMIW 


low 


high 


71 





82 



B. CA1 Computer Hardware 



». Hardware Components 



».3. CA1 Terminals 

♦.3.3. Flat Panel Display Terminal! 

1. Cost Requirements 



//////////////////////////////////////////////// 


low 


high 


2. Support Capacity 




llllllllllimillllllllllllllllllllimilllllllllH 



low N*" 



±RJC 



72 

S3 



B. CAI Computer Hardware 



4. Hardware Components 

M, Communication!. 



Section Technical Vocabulary 

modem 

dedicated/ unloaded telephone lines 
baud rate 

acoustically coupled modem 

direct connect modem 

multiplexer 

star network 

ring ne work 

data packets 

communication protocol 



Whether the CAI system to be adopted is a time-shared central computer 
system, a modular computer system, or a network of stand-alone computers, some 
form of communication system will be needed to allow various users (students and 
instructors) to communicate with the computer and with each other. The type of 
communication system used can be characterized by the mechanism of data 
transmission within the system. On this basis, there are three types of 
communication systems pertinent to the typical use of a CAI system. The first 
type centers on the use of dial-up, telephone modems. The second type uses 
dedicated telephone lines, and the third type uses cable or twisted wire lines 
within a building or between buildings that are close together. 

An important measure of the capability of a communication device or 
system to transmit data is the "baud rate." The baud rate determines how much 
and how fast data can be transmitted between a terminal and a computer, or 
between two computers. The higher the baud rate, the faster a CAI system can 
respond to the inputs of a student. 

Dial-Up Modem. The dial-up modem is a device that will allow a 
telephone anchor a voice-grade telephone line to be used to transmit CAI lessons 
or data between the computer and its terminals, or between computers. There 
are basically two types of dial-up modems. One Is an acoustically coupled modem 
and the other is an auto-dial, direct- connect modem. The first requires the user 
to manually make a connection to the computer by dialing a telephone access 
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number and then physically placing the telephone receiver on connecting ports of 
the modem. The second type is connected between the telephone and the 
telephone line and automatically "dials" the computer through commands from the 
terminal. 

a.ft.1.1. Cost Requirements. Dial-up modems are fairly inexpensive. 
Acoustic modems average about $120, and auto-dial modems average about $250. 
Communication costs associated with charges from the telephone company can be 
kept low because the telephone lines are being used only when they are needed 
(not dedicated line». 

1.2. Support Capacity. Acoustic modem* generally transmit data at 
300 or 1,200 baud. At 300 baud it will take approximately 26 seconds to transmit 
1,000 characters. At 1,200 baud it will take approximately 7 seconds to transmit 
the same 1,000 characters. An auto-dial modem typically transmits data at rates 
between 1,200 baud and 9,600 baud. However, typically 1,200 to M00 baud is all 
that can be expected with voice-grade lines. At M00 baud, it takes 
approximately 2 seconds to transmit 1,000 characters. Low baud rates make it 
difficult to provide CAI with a great deal of graphics except for character-based 
graphics. Additionally, slow response time during student-terminal interaction 
can be distracting and irritatingly slow. Voice-grade line transmission of data is 
the most subject to interference. However, with voice-grade lines and dial-up 
modems, users of a CAI system can be anywhere In the country where telephone 
service is provided. 

4.4.2. Dedicated Telephone Lines. A dedicated telephone line allows 
users to be permanently connected to a computer. Because the telephone line is 
dedicated to one user, such quality of transmission can be upgraded. Such 
telephone lines are usually referred to by the telephone company as conditioned or 
unloaded lines. With a dedicated line, a device called a multiplexer is normally 
installed to allow more than one terminal to use the dedicated line. A typical 
multiplexer would allow up to eight terminals to use a single dedicated line, 
helping to keep communications costs as low as possible. 

4.4.2.1. Cost Requirements. The biggest cost associated with the use of 
a dedicated line is the cost of renting the telephone line from the telephone 
company. This cost varies with the distance between the computer and the users, 
but can run over $1,000 a month for very long distances. A multiplexer will cost 
approximately $2,000 to $5,000 and will vary with the number of users supported. 

M.2.2. Support Capacity. The transmission rate over a dedicated line 
can usually be higher than transmission rates over voice-grade lines. With a 
dedicated line, baud rates of 9,600* are possible. At 9,600 baud, it would take 
approximately 1 second to transmit 1,000 characters. Dedicated lines have less 
interference associated with them. 

4.4.3. Local Network. The local network consists of a system of coaxial 
cables or regular, twisted pair lines (telephone wire) which connect computers 
and/nr terminals together at a single, geographic site. There are basically three 
types of local network configurations! hierarchical, star, and ring. In the 
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hierarchical network, a central computer communicates with intermediate-level 
computers down to the user level. In a training organization, a hierarchical 
network would be one whsse a central computer is at the training base level and 
communicates with computers at the training group or branch level. In a 
hierarchical system, communication between intermediate- level units has to pass 
through the central computer first. In a hierarchical network, interunit 
communications can be tightly controlled. 

In a star network configuration, a central unit communicates directly to 
the user units connected to it. The user units and their communication lines can 
be visualized as radiating out from the central unit in a star pattern. As new 
units are connected into a star- type network, a new communication line is 
connected for each new unit. 

In a ring network configuration, a single cable or bus is strung around the 
facility. AU units are connected to this bus and can communicate in an equal 
fashion to all other units on the bus. In a ring type of system, the bus is put in 
place and units are connected to it as needed. The units that are connected can 
be terminals, computers, memory storage units, etc. A ring type of network is 
very democratic in that all units connected are accessible. See Figure III-* for 
diagrams of the three network configurations. 

4.4.3.1. Cost Requirements. For a ring type of system, the complete 
network is usually put in place at the beginning even though a full complement of 
users will not be connected right away. A ring network also is based on the use of 
cable and sophisticated electronics which sort out the "data packets" from the 
separate users to ensure that data are transmitted to the proper place. 

A star-type network is frequently based on twisted wire pairs, which are 
less expensive than coaxial cable? however, for every unit in the network a 
separate communication line is needed. The communication protocol (the 
determination of when each unit communicates) is handled by the central unit in 
the system. This usually requires less costly electronics than for a ring-type 
network. 

A hierarchical network usually combines a cable system with twisted 
wire pairs. Intermediate-level units (i.e., computers) are connected to a more 
remote central unit by cable while local terminal-type units are connected to the 
intermediate unit via twisted wire pairs. 

4.4.3.2. Support Capacity. In a star- type network, the number of users 
is determined by the number of communication ports available on the central unit. 
For a ring type of system, the number of users is determined by the sophistication 
of the communication electronics of the network. In a hierarchical network, the 
number of users is a function of the number of communication ports that exist at 
each level within the hierarchy. 
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r. c.Al Software Support 

1. Higher Order Languages 

A higher order language (HOL) is a general -pur pose ^computer language 
that can be used for a variety of applications, including the development of CAI 
c^urs^ar^. Samples of popular HOLs are BASIC, FORTRAN, Pascal, and 
An HOL represents a very fundamental way of o«M 
instructions to a computer. However, because an HOL has to serve a variety ox 
l£rs and their appUcaTons, the commands to be found in them have to Mb. .genera 
purpose; thus, there will be no commands peculiar to CA! applications. CAI 
cTuWeWare developed in an HOL will be stored as a 

lesson developed will be a separate computer program. ^Figure : III-5 "l^tesa 
simple multiple-choice question that can be found in a CAI J™*™- m * 
shows how this question would have to be programmed using the BASIC HOL. 

1.1. Coat Requirements. HOLs represent the smallest capital 
investment oi aii the £Al software support types because most t^ware 
manufacturers include at least one HOL as part of ^sy*temj™tttey^ 
Almost all Dersonal-type microcomputers come with a form of BAsK- 
^rammed SoWC* only memory) within the computer However, in 

of recurring costs, HOLs can be very expensive because they . "^™«* 
most time to develop good CAI courseware. Also, HOLs require special 
programming staff in order to be properly utilized. 

1.2. Staffing Requirements. The successful use of HOLs for the 
develop ment of good CAI courseware r equires the use of ^edgeab^ computer 
pr^g ammers. Simple informational, drill-and-practice, and tutor iaj CAI can Q be 
Accomplished by instructional staff willing to take the time to tearn .an HOL, 
nowever, any CAI which involves more than rudimentary graphics and/or 
branching strategies will require professional programming skills. 

1. 3. Training Requirements. If the Instructional staff is expected to use 
an HOL for the development ot CA I courseware, then that staf will have to 
^eivVextensive training in computer P"*"^!^ 

instructional personnel in computer programming unless the personnel are to oe 
part of a long-term and stable development group. 

l.ft. Organizational Requirements. The pr oper use of an HOL for CAI 
development requires the establishment ot a courseware * vel ^f" J!?t r.^r 
T team^onsistsof at least two types of individuals: » {" t ^^^ ,t ^ 
exoert and a computer programmer. However, unless the instructors are 
ffiedSeable in^mstrucfional strategies and design, it is also recommended 
thai "to courseware team have an instructional design person as a member. 

Because programming in an HOL can involve a great deal of time and 
effort ch^^re^isions in the instructional design of a CAI lesson need, to 
^Tf"^ once programming is initiated. ^f^^Jjj ^ 
review procedures must be in place to ensure that most content and design 
problems are worked out prior to programming. 
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A ytliow Ught meanst 

1. Spetd up 

2. Stop 

3. Slow down 



Figure 111-5. Sample multiple- choice question 
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The Question as a Sequence of BASIC Code 

10 VTABUOh HTAB (*) 

20 PRINT "A YELLOW LIGHT MEANS" 

30 VTAB (13): HTAB (9) 

40 PRINT "0 SPEED UP H 

50 PRINT: HTAB (9) 

60 PRINT "2) STOP" 

70 PRINT; HTAB (9) 

80 PRINT "3) SLOW DOWN" 

90 INPUT ANS96 

100 IF ANS% = 1 THEN GOTO 1000 

1 10 IF ANS% = 2 THEN GOTO 1000 

120 IF ANS% = 3 THEN GOTO 1010 

200 REM: REST OF PROGRAM: STEPS 210-900 

1000 VTAB (23): HTAB {ih PRINT "NO THAT IS WRONG" 

1001 GOTO 200 

1010 VTAB (23): HTAB (1): PRINT "R.JHT" 

1011 GOTO 200 



Figure 111-6. Multiple-choice question coded in BASIC 
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n.«tK»n« ijyV^' *" HOL Pfo»id« the greatest amount of 
flexibility in abating CAf became the commands In an HOL represent the 

^„ m *""i , buil<Sn « 1 W «F!» * computer program. Mn, TcAMesson 
developed in a properly chosen HOL can be transported to different combers 
re«tj£ tt>e same version of the HOL. CAI lessoWdeveloped tfn « HoT*ould 
pr 2? n JLlf ,b f e " re ** of instruction because later modification of such le^on. 
^fllL di "i t 3l!i. e,, f cU " y 11 •"""a" Programmers are tavoWe < lJ*Zttb££ 

«»n^~a^i^T,l. d0 T? t r, ,Son p™*™- » «S VSUTSSK 

extensive and unique types of simulation, an HOL may represent the oniv 
effective means for accomplishing the development of such *es£Ef * 
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fii SMMtfffl»tt»Wi 

b Hi^QrdtrL«niUi«t 
1, Purchase or licensing ooat 



mmiimii 



low 

2. Staffing requirements 



///////////// 



current instructional professional 

instructional staif with programmers 

staff »me programming 

3. Training requirements (staff) 

Imiiiiiiiiiiiiiiiiiiniiiiiiiiiiiiiiiiiiiiiif 11111111111111 

low 

4. Organizational requirements 

/////////////////////////////////////////////////////////////// 



low 

5. Support capacity (of CAI development) 



high 



////////////////// 



low 

6. Relative efficiency of courseware development 



high 



llllllllllllllllll 



low w Sh 
7, Relative amount of CAI development time required 



//////////////////////////////////////////////////////// 
low 



high 
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C. CAl Software Support 



2. Authoring Lang uages 



to the deSuf SHL 1 « Spe ^- pUrp ° Se Com P uter lan ^« e specific 
^ifj^IrT^ " 1 The co^^and structure of an authoring ianeuaee is 

specific to the instructional functions that are necessary to oreLnT^f 
graphics, accept student input, evaluate stud* inouT and s r !^h 1 ° r 

"^T^r art 1 ? 5*5? ^^WKfia 
crsr^^x™"" to developmen, ° f cai and 

the Air F^^un 6 ^" 1 """ 1 ?- A " authorin S languages with the exception of 

language is beinT used ^^ tiZ sonie cerement of the time the 

nrll^SlJL 8 ' A,so ' licensi ng may occur on the basis of a using site or 
organization regardless of the number of individual copies being Jsed or thi 
licensing may be based on the number of ir.dividual copies Sfed. ' 

sophisticated authoring languages such as TUTOR? that ha? severS \ huZS 
command,, the level of application programming sklU Quired caTbelne^erv 

iX^SwiS 8 „e s e ^d o 4'c:oe* , !hi d l per,onne ' -r 1 ^^^ ^ms 

in£udor, W 'as XS^VS^JL^T'SSt £2ff Jfe «£ «? A 

sTcLTzedtai^V^ 86 " 0t te ~-P«««T4r1mm«s btt »U 
require specialized training in and experience with the authoring language. 

CAl les»ns. For an expert level of performance with an authoring language, timt 
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The Question in Apple PILOT 



♦PART 1 

Tt A YELLOW LIGHT MEANS 

Ts 

Ti 1) SPEED UP 
T« 

T* 2) STOP 
Ti 

Ti 3) SLOW DOWN 
Ai 

M3: 1 

T* NO, THAT IS WRONG 
h PART 2 
Mil 2 

Ti NO, RED MEANS STOP 
Ji PART 2 
M3» 3 

Tt YES, THAT IS CORRECT 
♦PART 2 

Figure IH-7. Multiple-choice question coded via the authoring language PILOT 
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The Question as a Sequence of TUTOR Code 

UNIT TRAFFIC 

WRITE A YELLOW LIGHT MEANS 

1) SPEED UP 

2) STOP 

3) SLOW DOWN 



ARROW m 


ANS 


1 


JUMP 


BD7 


ANS 


2 


JUMP 


BD11 


ANS 


3 


JUMP 


BD9 



Figure IU-&. Multiple- choice question coded via the authoring language TUTOR 
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and experience am needed to become proficient with the full power of the 
authoring language. 

2.». Onanizational Requirements. The use of an authoring language 
will simplify the production of CAI as compared to the use of an HOLj however, 
the extensive development of CAI, even with the use of an authoring language will 
require the establishment of a dedicated group of development personnel. A team 
approach to development is advisable, with instructional personnel and SMEs 
storyboardlng a lesson, which then is turned over to coders who are expert in the 
use of the authoring language. 

2.5. Support Capacity. An authoring language will provide for more 
efficient production of CAI lessons. For a start-up CAI development effort, the 
use of an authoring language, as compared to an HOL, can reduce the 
development time by as much as 60 percent. AlsO, the revision and maintenance 
of developed lessons is significantly enhanced by the use of an authoring language. 
To some degree, a good authoring language can be self-documenting. 
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C. CAI Software Suooert 




2. 


Authoring Languages 




1. 


Purchase or licensing cost 

imiimimimimimimuHi 
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2. 


Staffing requirements 
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instructional staff with 

MHIIUVMVIIW 9MmA Willi 

staff some programming 


professional 
program triers 


3. 


Training requirements (staff) 
////////////////////////// 






low 


high 


4. 


Organizational requirements 

////////////////////////////////// 






low 


high 


5. 


Support capacity (of CAI development) 

///////////////////////////////////////////// 






low 


high 


6. 


Relative efficiency of courseware development 
//////////////////////////// 






low 


high 


7. 


Relative amount of CAI development time required 
//////////////////////////// 





low high 
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C. CAI Software Support 



3. Authoring System* 

An authoring system uses a courseware development approach that does 
not require computer code generation as part of the instructional development 
process. Rather, an authoring system primarily involves the use of editors which 
contain a series of menus, prompts, and help sequences. These editors elicit 
information from the "author" of a CAI lesson, based on the instructional function 
to be performed. Using the multiple-choice example of Figure HI-5, a typical 
authoring system would allow an author to enter the text of the question by 
simply typing it on the screen in the location desired. After the text of the 
question is entered, the authoring system would then elicit information via a 
prompt asking which question alternative is the correct answer and where in the 
lesson the students should go if they answer either correctly or incorrectly. An 
example of an authoring system editor display is shown in Figure IiI-9, from the 
Air Force's CASS Authoring System. An authoring system will often consist of 
several different types of editors corresponding to specific lesson-generation 
activities such as creating lesson graphics or producing a lesson menu page. Other 
examples of existing authoring systems are the WISE Authoring System, 
Professional Authoring Support System (PASS), The Authoring Procedure for 
TiCCIT (APT), and PCD I (PLATO Course Development). (PCD2 is expected to be 
available shortly.) In addition to the CASS Authoring System, the same 
contractor has developed an authoring capability called SID, a simulation 
development authoring capability. 

3.1. Cost Requirements. Authoring systems are very powerful and 
complex development tools. As a consequence, their development required an 
extensive investment by the companies which provide them. The licensing fees 
for authoring systems can cost as much as the hardware on which they will run 
(exception is government-owned software such as CASS). Front-end licensing 
costs will approximate $5,000 to $60,000. Additionally, there will be yearly 
maintenance charges for maintaining the currency of the authoring system. An 
authoring system dramatically improves the efficiency of the CAI courseware 
development process; thus, the costs of courseware development and maintenance 
are significantly reduced. 

3.2. Staffing Requirements. The use of an authoring system can 
eliminate the need for specialized staff consisting of coders or computer 
programmers. The editor-based approach of an authoring system permits 
instructional personnel to author their own lessons directly. However, for large 
courseware development projects, some efficiency is still gained by having certain 
staff personnel specialized as lesson authors even with the use of an authoring 
system. 

3.3. Training Requirements. The use of an authoring system requires 
the least amount of training. The effective use of an authoring system can 
usually be gained in 1 week whereas from 2 or 3 weeks to as long as 1 year are 
needed for the effective use of an authoring language. The criterion being applied 
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FRAME 5t QM1 



INSERT MODE 7.Lines 



1. 
2. 
3. 

5. 
6. 



This is a sample multiple-choice question with 
THREE alternatives. 



2. 



1. 



This is alternative two. 



This is alternative one. 



7. 



3. This is alternative three. 



Options; Enter multiple- choice question alternatives. 
Press NEXT to end each line. 

A line with no material (just a NEXT key) will allow question alternative 
entries. 

COPY keys copy previous line. 
Press BACK when finished. 



Figure IH-9. Completed multiple-choice question 
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in each cm is the c a p ab ility to creatively tm the majority of the CM 
functionality provided by the authoring system or language* 

3.*. Organisational Requirements. Because an authoring system can be 
effectively and quickly used by regular instructional personnel, It imposes the 
least demand on the establishment of unique organizational structures to 
accommodate the courseware development process. An authoring system is the 
best choice when CA1 courseware has to be integrated into the work environment 
as an additional duty of the instructional staff. 

hit Support Capacity* An authoring system provides a highly efficient 
means of CAI courseware production. The use of an authoring system generally 
requires only one-quarter of the time it takes to develop CAI using an HOL and 
approximately half the time it takes using an authoring language. The 
maintenance of existing courseware is highly improved with an authoring system 
because the recorded inputs for each editor menu represent an on-line form of 
documentation of exactly what was done to create the lesson. Though an 
authoring system is very efficient for the production of courseware, It can alio be 
limiting to the degree that the format and options provided in its editors limit the 
use of certain instructional strategies. 

Another aspect of an authoring system is that the lessons developed are 
represented as a data base rather than as a computer program. Most authoring 
systems consist of two separate programs. The first program is an author 
program that leads the author through the creation of a lesson data base. The 
second program is a delivery program that reads the created data base and 
conveys it as a lesson on the student's terminal. The advantage of this is that the 
authoring and delivery processes can be separated. Authoring usually requires a 
more soptiisticated set of hardware than dees delivery. Thus, with an authoring 
system i lower cost hardware can be bought for the delivery systems that have to 
exist in larger quantities than the systems use i for authoring. Another advantage 
of the data base structure of an i s, wing system is that developed components of 
existing lessons can usually be cc;weniently borrowed and incorporated Into new 
lessons being developed. 
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Cm CAt Software Support 

3. Authoring Systems 

1. Purchase or licensing cost 



iiiiiimiimiiiiimtimiiiiiitiiiiiitiiiiiiiiii 

low high 

2. Staffing requirements 

Wmmiiiim ~ 

current instructional professional 

instructional staff with programmers 

staff jome programming 

3. Training requirements (staff) 

Wllllllllllllllllll ~ 

low high 
Organizational requirements 

Wllllllllllllllllll ~ 
low high 
5. Support capacity (of CAI development) 
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low high 

6. Relative efficiency of courseware development 

iJiuiiuiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiir 

low high 

7. Relative amount of CAI development time required 

///////////////////////// ~ 
low high 
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C. CAI Software Support 



». Design Systems 

A design system is a fairly new concept ami is an extension of the 
principles underlying an authoring system. An authoring system focuses on the 
provision of capabilities that permit instructional personnel to readily manipulate 
the presentation and control capabilities of a CAI computer system. Though an 
authoring system makes it easy to program text and graphics and branch the 
learner from one lesson segment to another, it does not usually provide explicit 
guidance as to the design of a lesson. In this sense, authoring languages and 
authoring sytems can be considered design free even though they may constrain 
the use of certain instructional strategies. A design system is a set of computer- 
based editors that lead a content expert through a systematic design process. A 
design system can either be a separate set of procedures or be an Integral part of 
an authoring system. In either case, a design system is based en an explicit model 
of the learning and/or Instructional process. The editors of a design system seek 
information from a content expert or instructor on the basis of the learning or 
instructional model used. The Authoring Procedure for TICCIT (APT) is an 
example of a design system implicit in an authoring system. The Air Force's 
Training and Performance Support System (TPSS) provides an example of a design 
system separate from the authoring system. Design systems themseives are 
currently being designed and are expensive. More affordably priced systems are 
expected to be available in the next few years. 

fhU Cost Requirements. The concept of design systems is still 
developing; thus, there are limited cost data. However, commercially available 
design systems should have software licensing costs similar to those for authoring 
systems. The use of design systems should further reduce the costs of producing 
new CAI courseware. 

U.2. Staffing Requirements. The use of a design system will enable 
instructor/content experts to systematically organize the content of a lesson, 
course, or curriculum on the basis of a learning model and/or instructional model 
appropriate to the capabilities of a CAI system and the knowledge and skills 
underlying an area of instruction C«e., management training, electronics 
troubleshooting, mathematics, etc.). The use of a design system should reduce the 
number of specialized staff personnel required to develop and maintain CAI 
courseware. 

Training Requirements. The production of good CAI by the typical 
instructional staff normally requires that that staff be trained in the detailed 
nature of CAI design strategies appropriate to different areas of instruction. The 
use of a design system, if available, permits the instructional staff to engage 
more quickly the CAI development process in an effective manner. 

Organizational Requirements. The use of a design system 
minimizes the requirement for the establishment of specialized CAI development 
staff apart from the normal instructional staff required to conduct training. 
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Support Capacity. The typical development of CAI courseware 
requires tKrea area* of expertise! The first area is content expertise. The second 
is instructional design* and the third is programming. Authoring languages and 
systems function to provide systematic support for the instructional staff, 
enabling them to program CAI lessons. A design system likewise provides 
systematic support to tlie instructional staff , enabling them to design CAI 
courseware more appropriately. In considering the adoption of a CAI system 
which may have an embedded design system, one needs to judge the 
appropriateness of the learning and/or instructional models it uses for the 
intended training. Independent design systems can be used with either authoring 
systems or languages to effect the programming of CAI courseware. 
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C. CA1 Software Support 

». Design Systems 

1. Purchase or licensing cost 



////////////////////////////////////////////////////////////// 
low high 
2* Staffing requirements 

IIUIIIIlllllllll 

current instructional professional 

instructional staff with programmers 

staff some programming 

3. Training requirements (staff) 
7777///////////////// 

low high 
Organizational requirements 

7777///////////////// 

low high 
5. Support capacity (of CAI development) 

WiiiiiuiiiiiuiiiiiiiiiiiiiiiuiiiiiiiiiiiiiiiiiiiiiiiiiTi 
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6* Relative efficiency of courseware development 

WllllllllllllllilllllllHIIIIIIIIIIIIIIIIIIlllllllllllllTfl 
low high 
7. Relative amount of CAI development time required 

////////////// ~ 
low high 
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D. Courseware 



1. Informational CA1 

Informational CAI Is used as an adjunct to or in support of the primary 
instructional delivery (e^., the instructor, programmed text, tutorial CAD. The 
information is usually stored in the computer as a data base of individually 
addressable nodes or frames of either text alone or of text and graphics. This 
form of CAI is a particularly good choice for in-house development because it 
requires minimal skill with computers and Instructional sequencing. Therefore, 
with the widely available authoring aids, an instructor or other subject-matter 
expert could develop or revise informational CAI quickly, A further description 
of informational CAI is provided in Section II. D. 
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p. Courseware 




1. 


Informational CAI 




1. 


Overall complexity of development 
HIIIIIIIUIII 






simple 


complex 


2. 


Relative cost of development and revision* 
////////////// 






low 


very high 


3. 


Relative level of organizational impact* 
////////////// 






minor 


major 




Staff in e reauirements for develooment and revision 

///////////////// 






conventional trained conventional 
staff staff 


trained CAI 
staff 



♦Relative to other forms of CAI. 
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D. Courseware 



2. Drill-and-Practice 

Drill-and- practice allows the opportunity for enhanced learning through 
repeated practice on both knowledge- and performance-level instructional tasks. 
Two general categories or levels of drill- and- practice are described below. They 
require different levels of resources and provide different levels and types of 
instructional and institutional benefits. 

Level It Nonadaptive. Nonadaptive drill-and- practice is the 
presentation of questions about factual information, concepts, and procedures. 
The sequence is fixed G«e., not generated based on past or current student 
performance data). This It a good candidate for in-house development because 
some development aids are available and because it requires relatively few 
resources. 

Level 2: Adaptive. Adaptive drill is a form of practice similar in 
content to Level 1 but, in addition, it takes into account past and current student 
performance data in the selection of practice problems, in the amount and type of 
feedback, and sometimes in the form of remediation, if any. This is a more 
complex type of CA1, requiring more specifically trained personnel who can make 
design decisions about program sequencing and feedback. This is a good candidate 
for in-house development if trained development personnel are used. 
Sophisticated authoring tools are not widely available, but authoring languages 
exist to support development of adaptive drill-and- practice. A further description 
of drill-and-practice is provided in Section II.D. 
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D. Courseware 

2» Prill - ano^PractiOs 



Level li Nonadaptlvc Level 2: Adaptive 



1. 


Overall complexity of development 






////////////// ////////////// 




2. 


simple complex simple 
Relative cost of development and revision* 


complex 




////////////// ////////////// 




3. 


low very high low 
Relative level of organizational impact* 


very high 




////////////// l/IIIIUIIIUI 






minor major minor 
Staffing requirements for development and revision 


major 




////////// /////////// 





conven- trained trained conven- trained trained 

tionai conventional CAI tional conventional CA1 

staff staff staff staff staff staff 



♦Relative to other forms of CAI. 
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D. Courseware 



3. Tutorial CAI 

Tutorials present instruction, providng direct instruction and taking the 
place of other forms, such as programmed text, instructors, etc They usually 
consist of text and graphic explanations and are typically interspersed with 
embedded questions. Interactivity usually consists of the embedded questions, 
feedback, branching, and some learner control over help sequences and flow 
through the lesson. 

The development of sound tutorial CAI is dependent on a skilled 
development staff; in-house tutorial CAI development is recommended if such 
staffing is available. There are some authoring tools available that can be quite 
helpful. The more sophisticated the tool (authoring or cfr sign system), the more 
conventionally skilled the development staff can be. i\ further description of 
tutorial CAI is provided in Section H.D. 
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D. Courseware 

3. Tutorial CAI 

Developed Using Programming Developed Using Authoring 

or Authoring Languages or Design Systems 

1. Overall complexity of development 



//////// 'fill I III I III lllll III II I III I III 1 1 II 



simple complex simple complex 

Relative cost of development and revision* 

(personnel costs) (authoring aids costs) 



///////////////////// llllllllllllllllllllllllll 



low very high low very high 

3. Relative level of organizational impact* 



IIIIIIIIIIIIIIIUItlllllillHUIIIIII llllllllllllllllllllllllll 



minor major minor major 

4. Staffing requirements for development and revision 



//////////////////////////////// llllllllllllllllllllllllll 



conven- trained trained conven- trained trained 

tionai conventional CAI tional conventional CAI 

staff staff staff staff staff staff 



•Relative to other forms of CAI. 
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D. Courseware 



Simulation 

Simulations give students the opportunity to practice procedures or solve 
problems. A simulation can "stand <n stead* of objects or systems and mimic 
changes in states based upon student actions. Simulations can also coach or tutor 
students along the way. Simulations are good Instructional candidates when they 
diminish exposure to danger; time required to masteryj or reliance on more 
expensive, scarce or hazardous actual equipment. Level 1 below Is a relatively 
good candidate for ir.-house development, whereas 2 is a good candidate for 
external development. 

Level 1. Simulations at this level depict processes and/or equipment in a 
physical senseTLe'., a piece of equipment at various stages of operation or with 
various faults. 

Level 2. Simulations at this level depict interacting process."- and/or 
several pieces of equipment simultaneously; i.e., a nudear power plant operation 
or a complete flight simulator. 

A further discussion on simulation is provided in Section II.D. 
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D. Courseware 

». Simulation 

Level 1 Level 2 

1. Overall complexity of development 



//////////////////////////// /////////////////////////////////// 



simple complex simple complex 

2. Relative cost of development and revision* 

(personnel costs) (authoring aids costs) 



//////////////////////////////// ///////////////////////////////// 



low very high low very high 

X Relative level of organizational impact* 



//////////////////////////// ////////////////////////////////////// 



minor major minor major 

*t. Staffing requirements for development and revision 



/////////////////////////////////////// generally external development 



conven- trained trained conven- trained trained 

tional conventional CAI tional conventional CAI 

staff staff staff staff staff staff 



♦Relative to other forms of CAI. 
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D. Courseware 



5. Inquiry CA1 

Inquiry CAI requires the user-students to initiate and control the 
sequence of the content presentation. This form of CAI can provide information, 
instruction, and practice segments but the objectives for their use and the 
sequence In which they are viewed are totally dependent on the user. More than 
just learner control, inquiry CAI requires the computer-based system to be 
"smart? and "user friendly interfacing with the user through menus, keywords or 
natural language input. 

This is not a good candidate for in- ho use development, and authoring aids 
for development of inquiry CAI which go beyond the use of sample menus are not 
commercially available. A further description of inquiry CAI is provided in 
Section U.D. 
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D. Courseware 



6. Intelligent (Generative) CAI 

ICAI has taken some of the techniques of artificial intelligence and 
combined those techniques with the original objective of tutorial CAI in order to 
form true Socratic dialogues or coaching sequences. This is a form of CAI that is 
still in its infancy, but there are R&D efforts currently underway throughout DoD. 

This form of CAI is not a good candidate for in- house development for 
two reasons. First, the type and level of development expertise required for ICAI 
will usually not be available in-house. There are research and development groups 
that are working in this area and if ICAI is going to be adopted, external 
contractors may be helpful. Second, development or authoring aids are not as yet 
commercially available. Within the next 5 to 7 years, ICAI generation systems 
may become available but until that time, external development of ICAI is 
recommer&d or applying some ICAI techniques to tutorial CAI development is 
suggested. A further explanation of ICAI is provided in Section II. D. 



105 

116 



D. Courseware 

6. Intelligent (Generative) CAI 
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IV. DECISION AIDS FOR CONSIDERING THE ADOPTION OF CAI 



A. Use of This Section 



In previous sections, this handbook provided factual information about 
CAI, innovation and change, CAI efforts in the Department of Defense, cost 
factors, and related considerations in the CAI adoption process. This section does 
not present any new information. Rather, it orovides the decision aids needed to 
assess the value of CAI in a particular training situation. These decision aids 
consist of worksheets with point scores and a decision flow chart. In this decision 
process, it may be helpful to refer to specific information in Sections H and in. 

It will be useful to study the Decision Flow Chart (Figure IV. 1) and the 
list of Decision Aids (Table IV- 1). It should be noted that decisions about 
hardware and software requirements are based on the instructional requirements. 
By determining the need-to-have and nice-to-have instructional features and 
functions, the software needed to support those functions can also be determined, 
and then the hardware that operates required software and meets organizational 
requirements can be selected. The result of choosing hardware before deciding on 
its function may be like buying a sports car and then realizing the real need was 
for a truck! 

It will be necessary for the user of this handbook to bring to this decision 
process a personal analysis of the specific training organization and also the 
specific course objectives. One further note of explanation! 

The decision to adopt CAI or to forego adoption of the 
medium at this time Is net usually made on the basis of a 
strict binary decision process or medU selection model. It 
cannot be explicitly prescriptive. Priorities, organizational 
structures, and other nonquantifiabie considerations must be 
weighed. The purpose of this decision aiding method Is to 
highlight for your consideration the many relevant factors 
and issues that must be considered. It may be an iterative 
process of a c co mm odation of requirements based on available 
resources. 



Use of This Section 



I 



Identify Potential 
Benefits of Using CAI 




MM 



D. Identify 
I Organizational and 
* Instructional Needs 
(New Course) 



existing 



E. Identify Organizational 
and Instructional Needs 
(Existing Course) 



STOP! 
Consider other 
alterna- 
tives. 



Do the* 
fdentlfled benefits^ 
problems and potentials, 
warrant the use 
of CAI? 



P. 

ADOPT] 
CAI! 



yea 



G* Match Training Objectives 
with CAI Methods 



yaa 



O. Factors for 
Successful Transi- 
tion to CAI 



yaa 

N. Can 
'organization accorffc 
modate CAI? 



yes 

M. Do needs 
and benefits offset 
costs?. 



H. Determine CAI Design 
Features Required 



I. Does 
CAI capability exisl 
in organization?, 



vsa 



3. Record Avail- 
ability of CAI 
Capability 



no 



K. Develop Shopping List 
of Needed CAI Capabilities 



i 



L. Estimate Costs of CAI 



Figure IV.l. Decision flow chart. 
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Table IV-i 
List of Decision Aid Worksheets 



1. Benefits Assessment 

2A. Organizational Needs (New Cours* ) 

2B. Instructional Needs (New Course) 

3 A. Organizational Needs (Existing Course) 

3B. Instructional Needs (Existing Course) 

4A. Training Objectives and CAI Methods 

4B. CAI Methods Identification 

5. CAI Design Features 

6. Availability of CAI Design Features 

7. Estimate Costs of CAI 

SA. Assessment of Organizational Communication 

SB. Assessment of Organizational Support and Resistance 
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Identify PotenSaT^eneiiU ^ Using CA1 

If the course that is being considered for adoption of CAI is new, it 
provides a unique opportunity to give consideration to what is possible rather than 
responding only to problems arising from an existing set of constraints In 
curriculum structure, staffing, or facilities. The use of CAI in an existing course 
often must follow an evolutionary process in its implementation; thus, the 
adoption process tends to be incremental. However, for a new course, adoption of 
CAI can be considered on the basis of its being a major component of the 
instructional delivery process. 

The following worksheet (Decision Aid 1) is structured to help in making 
a preliminary assessment of the need for CAI in a new or existing course as a 
function of both the training mission and the mission of the operational 
organization supported by the training group. 
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Decision Aid i 
Worksheets Benefits Assessment 



the «la2fJ 17 %ai * h%t Sl ^P*^" ™<V<* requirements that influence 
^ins^ f !. , Sev««i these items involve looking at 

S^folSng tcT m ™* r ' EvtlUate eaCh 01 the items 00 *• **** " f 



« , T 2 1 5 5 

irrelevant, essential 

unimportant requirement 



1. Provide pretraining i.i basic skills prerequisite to the 
required technical skills. M 

2. Provide lor specialized technical skills to be taught in the 
context of specific weapon or support systems. 

3. Reduce student time waiting for training, especially where 
the "Trained Personnel Requirement Is sporadic G.e., not a 
constant and consistent input). 

4. Accommodate highly variable aptitude levels in the trainee 
population. 

5. Reduce the number of highly experienced personnel needed 
to staff the training program. 

6. Compensate for the lack of or the expense of actual 
equipment or specialized equipment trainers. 

7. Provide direct training support in the job rather than 
classroom environment. 

8. Reduce the amount of time away from the job for training. 

9. Accommodate rapid changes in technical information. 

10. Provide familiarity with dangerous or infrequent operating 
conditions that cannot be simulated. 

11. Provide for a great deal of hands-on experience that 
cannot be simulated. 

12. Accommodate need for personnel to work predominantly as 
part of an integrated team. 



Rating 
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13. Provide for item motor skill behavior more than strong 

conceptual or rote skills. 
Ik* Accommodate frequently changing work procedures. 

15. Provide for ft substantial degree of interpersonal skills 
which are needed for adequate job performance. 



a. Add up the total value of your rating scores for items 1-9. 

b. Add up the total value of your rating scores for items 10-15. 

c. Subtract b from a. 



If the value in c. is greater tbsn^O, then CAI should be seriously considered as 
significant component in the course design and development. 



RECORD YOUR SCORE BUT DO NOT MAKE 
A PRELIMINARY DECISION AT THIS TIME. 



PROCEED TO SECTION C 



If the course for which you are considering CAI is a new course, 
PROCEED TO DECISION AID 2s 

"D. Identify Organizational and Instructional Needs for a New Course" 

2A. Organizational Needs 
2B. Instructional Needs 



If the course for which you are considering a CAI application is currently 
being delivered to students via some other method G-e., lecture, programmed 
text, etc.), 

PROCEED TO DECISION AID 3s 

"E. Identify Organizational and Instructional 
Needs for an Existing Course" 

3A. Organizational Needs 
3fi. Instructional Needs 

" — — — 1 \ 

\ 
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The following worksheet! (Decision Aid ?) require tome assumptions 
about the new course which is being considered for CAI. The responses regarding 
both organizational and instructional needs are then analyzed. 
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Select the number that most 



Decision Aid 2 
Worksheet 2A: Organizational Needs 

closely fits the need described by each question.* 
3 2 1 



Score Weighting 



Score 



1. Air Force requirements 
for people trained in this 
course. 


immediate 
shortage 


anticipated 
shortage 


normal 


if answer is 3 and QU 7 is 
scored as 1, subtract 2 
points from total score 




2. Importance of reduced 
training time. 


critical 


important 


currently 
adequate 


add 3 extra points if scores 
in QUs 1 and 2 are both 3 




3. Anticipated technical 
personnel requirements 
(TPR) change in the next 
2 years. 


higher 
number 


same 
number 


lower 
number 






4. Anticipated availability 
of qualified and trained 
instructors. 


critically lower 
number 


sliflrhtlv lower 

or same number 


Hi ohor 
1 ligl lCrt 

number 


boo j extra points n scores 
in QUs 3 and U are both 3 




5, Add three points for 
new course 












6. Course development and/ 
or revision time available. 


adequate 


short 


critically 
short 






7. Availability of qualified 
course developers and 
support resources 


more than 
adequate 


adequate 




inadequate 


subtract 3 points from 
total if scores in QUs 6 
and 7 are both 1 





♦As you work through Decision Aids 2 and/or 3, you may wish to apply different weightings than those 
recommended here. This exercise will be equally valuable as long as you rationalize those weightings objectively 
based on your particular training situation. 
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Decision Aid 2 (cont.) 
Worksheet 2A: Organizational Needs 







dm 


1 

* 


Score Weighting 


Score 


ft. Anticipated problems in 
standardizing course con- 
tent and procedures from 
class to class (e.g., safety, 
security ceru n cation, oper- 
ational environment, etc.) 


critical 


important 


N/A 






9. Will this course be conduct- 
ed in physically separated 
operational environments 
visited by mobile instruc- 
tional teams? 




partially 


no 






10. A significant portion of 
the instruction is non-AFSC 
specific *e.g., career devel- 
opment, refresher, basic 
skills, study skills, etc.) and 
resources for the course are 
scarce. 


yes to 
both 


yes, but 

adequate 

resources 


no to 
both 






Total 



Generally courses generating 

scores bet weens 2* and 36 should be considered for CAI and may be excellent candidates based on 

organizational needs alone. 

16 and 23 should be considered for CAI if instructional need score is greater than 
15. 

0 and 16 organizational needs alone do not justify adopting CAI. Requires an 
instructional need score greater than 25. 



CONTINUE TO WORKSHEET 208 INSTRUCTIONAL NEEDS 
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Decision Aid 2 
Worksheet 2fis Instructional Needs 





3 


2 


1 


Score Weighting 


Score 


1. Will your course have some 
objectives that are difficult 
to teach using current 
methods or any other media? 


yes 


very few 


no 






2. Have you already decided 
t« self-pace this course? 


yes 


ceJ-pace or 
self-pace se- 
lected sections 


no 






3. If your answer to the 
previous question was yes, 
is student reading ability 
adequate for programmed 
text (P.T.)? 


no 


P.T. not 
used 


yes 


add 3 points if scores in 
QUs 2 and 3 are both 3 




*. Rate student motivation 
for the course. 


low 


medium 


high 






5. Will students practice on 
potentially hazardous equip- 
ment or use potentially 
dangerous procedures? 


yes 


infrequently 


no 






6. Is the course procedural 
and practice intensive? (Do 
not include need for manual 
practice and dexterity skills.; 


yes 


no 








7. Will actual equipment be 
used for practice? (Do not 
include need for manual 
practice and dexterity skills.) 


yes 


no 
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Decision Aid 2 (contj 
Worksheet 2Bs Instructional Needs 





3 


2 


1 


Score Weighting 


Score 


8. If your previous answer was 
yes, could the equipment or 
the process be simulated on 
non-actual equipment? 


yes 


no 




add 2 points if scores in 
QUs 7 and 8 are both 3 and 
equipment is scarce 
or expensive 




9. Will your course require 
student teaming? 


never 


sometimes 


often 






10. Will incoming students vary 
widely in background and 
previous training? 


often 


sometimes 


never 






11. Are there secondary objec- 
tives in your course that are 
best supported with high 
instructor involvement (e.g«, 
orientation to military life, 
orientation to the AFSC, 
etc.)? 


none or yes 
but they are 
accommo- 
dated else- 
where 


some 


many 






Total 



Generally courses generating 

scores between; 26 and 38 should be considered for CAI and may be good candidates on their 

instructional needs alone, 

16 and 25 should be considered for CAI if the organizational need score is greater 
than 15. 



0 to 16 instructional needs alone do not justify adopting CAI. Requires an 
organizational need score greater than 23. 



PROCEED TO SECTION F. 
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Eg Decision Aid 3t Identify Instructional 



Before proceeding through the evaluation of a specific course or training 
system, it might be useful to consider two general and basic questions* 



Question 1. Does your course or training system accomplish 
its instructional objectives? Is It "successful" 
in meeting its training requirements? 



If you answered NO, and perceive that a training or organizational need 
is not currently being met, then it is reasonable to consider an alternative training 
response. To evaluate your instructional and organizational problems* 

PROCEED TO WORKSHEETS 3A AND 3B 



If you answered YES to question 1 and your training system or course is 
meeting its objectives! 



PROCEED TO QUESTION 2 



9 

ERIC 



119 

130 



Question 2. II the training system or course is meeting its 
objectives, why is CAf being considered at this 
time? 



There are numerous noninstructional reasons for considering inclusion of 
CAI in a training system. This question is intended to bring into focus the specific 
training organization, the course, and perhaps, any personal motivation. Listed 
below are a few of the possible noninstructional reasons for considering CAI: 



1. The conditions that contributed to the failure of previous 
attempts to make changes have been reviewed, 
addressed, and mitigated. 

2. Personal interest in the technology. 

3. Anticipated course resource and demand problems. 

4. The introduction of a major revision to an existing 
course. 



PROCEED TO WORKSHEETS 3A AND 3B 
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Decision Aid 3 
Worksheet 3A: Organizational Needs 

Select the number that most closely fits the need described by each question.* 





3 


2 


1 


Score Weighting 


Score 


1. Air Force requirements for 
people trained in this course. 


immediate 
shortage 


anticipated 
shortage 


normal 


if answer is 3 and QU 7 is 
scored as 1, subtract 2 
points from total score 




w mam nn r *fr j *a f> i~ ^ _ X — . -I. . .J 

i. importance 01 reduced 
training time. 


critical 


important 


currently 
adequate 


add 3 extra points if scores 
in QUs 1 and 2 are both 3 




3. Anticipated technical 
personnel requirements 
(TPR) change in the next 
2 years. 


higher 
number 


same 
number 


lower 
number 






*• Anticipated availability of 
qualified and trained 
instructors. 


critically lower 
number 


slightly lower 
or same number 


higher 
number 


add 3 extra points if scores 
in QUs 3 and H are both 3 




5. Is the course going through 
revision? 


yes, major 


yes, minor 


no 






6, Course development and/or 
revision time available. 


adequate 


short 


critically 
short 






7* Availability of qualified 
coursedevelopers and 
support resources 


more than 
adequate 


adequate 


inadequate 


subtract 3 ooints from 
totai if scores in QUs 6 and 
7 are both 1 





♦As you work through Decision Aids 2 and/or 3, you may wish to apply different weightings than those 
recommended here. This exercise will be equally valuable as long as you rationalize those weightings objectively 
based on your particular training situation. 
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\ Decision Aid 3 (contj 

Worksheet 3A: Organizational Needs 





> 


2 


■ 
l 


ooore weighting 


Score 


ft. Actual or anticipated prob 
lems in standardizing course 
content and procedures from 
class to class (eg., safety, 
^cv-ui * ijf (.er uucsuorif oper- 
ational environment, etc .). 


critical 


important 


N/A 






9. Is this course being conduct 
ed in physically separated 
operational environments 
visited by mobile instruc- 
tional teams? 


yes 


partially 


no 






10. A significant portion of the 
instruction is norvAFSC 
specific fe.g., career devel- 
opment, refresher, basic 
skills, study skills, etc.) and 
resources for the course are 
scarce. 


yes to 
both 


yes, but 

adequate 

resources 


no to 
both 






Total 



Generally courses generating 

scores between: 2* and 36 should be considered for CAI and may be excellent candidates based upon 

organizational needs alone. 

16 and 23 should be considered for CAI if instructional need score is greater than 
15. 

0 and 16 organizational needs alone do not justify adopting CAI, Requires an 
instructional need score greater than 25. 



CONTINUE TO WORKSHEET 3B 
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Decision Aid 3 
Worksheet 3B: Instructional Needs 





3 


2 


1 


Score Weighting 


Score 


1. Does your course have some 
objectives that are difficult 
to teach using current meth- 
ods or any other media? 


yes 


very few 


no 






2. Is your course currently self- 
paced? 


yes 


cell-pace or 
some sections 
are self-paced 


no 






3. If your answer to the previ- 
ous question was yes, is 
student reading ability ade- 
quate for programmed text? 


no 


P.T. not 
used 


yes 


add 3 points if scores in 
QUs 2 and 3 are both 3 




*. Rate student motivation for 
the course. 


low 


medium 


high 






% Do students practice on 
potentially hazardous equip- 
ment or use potentially 
dangerous procedures? 


yes 


infrequently 


no 






5. Is the course procedural and 
practice intensive? (Do not 
include need for manual 
practice and dexterity skills.; 


yes 


no 








7. Is actual eaulpment used for 
practice? (Do not Include 
need for manual practice and 
dexterity skills.) 


yea 


no 
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Decision Aid 3 (contj 
Worksheet 3Bs Instructional Needs 



Score 



4. If your previous answer 
was yes, could the equipment 
or tneprocess fie simulated 
on non-actual equipment? 


yes 


no 




add 2 points if scores in 
QUs 7 and 8 are both 3 and 
equipment is scarce 
or expensive 




9. Does your course require 
student teaming? 


never 


sometimes 


often 






10, Do incoming students vary 
widely in background and 
previous training? 


often 


sometimes 


never 






11. Are there secondary objectives 
in your course that are best 
supported with high instructor 
involvement fe.g., orientation 
to military life, orientation 
to the AFSC, etc.)? 


none or yes 
but they are 
accommo- 
dated else- 
where 


some 


many 






Total 





Generally courses generating 

scores between: 26 and 38 should be considered lor CAI and may be good candidates on their 

instructional needs alone. 

16 and 25 should be considered for CAI if the organizational need score is greater 
than 15. 

O and 16 instructional needs alone do not justify adopting CAI. Requires an 
organizational need score greater than 23. 



PROCEED TO SECTION F 
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F. Do the Identified Benefits, Problems 
and Potentials Warrant the Use of CAI? 



Sti.!ii MOT 



The scores derived from worksheets in Decision Aids 1 and 2 (or 3) should 
provide a strong indication of whether there is a justification for further 
investigation and consideration of the potential adoption of CAI* If the score 
from Decision Aid 1 is very high (over 28), CAI should be considered regardless of 
the outcome from Decision Aid 2 or 3. 



If scores on the worksheets provide justification based on need, or if you 
choose to proceed in the investigation of CAI, 

PROCEED TO DECISION AID *t 

n G. Matching Instructional Tasks to CAI Methods' 1 



If scores on the worksheets do not provide any justification for further 
consideration of CAI, 

CONSIDER NON-CAI ALTERNATIVES 

The bibliography in Section V of this handbook provi >s references to 
media selection models that may be of help in considering non-CAI alternative 
solutions to training problems. 
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G. Decision Aid »t 
Matching Instructional Tasks to CA1 Methods 



The costs of CAI vary with the configuration chosen. Before the labor 
and cost implications of CAI can be estimated, it will be necessary to work 
through the following several worksheets In order to identify the CAI methods and 
supporting features that best match your requirements. 

The following worksheet (Decision Aid t) asks specific questions about 
the training targeted for potential CAI adoption. Each question describes an 
instructional attribute or learning outcome. The objective of this decision aid is 
to help in determining which CAI method matches a particular objective. 
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Decision Aid » 
Worksheet *At Matching Objectives with CA! Methods 



Answer each of the following questions about your training objectives. 
Circle the appropriate responses. 

I. Do students require factual .formation in order to solve Yes No 
the instructional problem (eg., does the student need to 

refer to manufacturer's specification!)? 

2* Is the course a refresher or brush-up training in very Yes No 
specific areas? 

3. While learning a new task, would students benefit from Yes No 
immediate feedback for each step in the solution to a 
question or problem? 

*. Do students need to learn procedures or nomenclature "by Yes No 
heart" (recall)? 

5. Would students benefit from direct instruction interspersed Yes No 
with relevant objective or constructed-answer questions? 

6* Can students effectively master instructional material by Yes No 
reading, listening or watching the material passively? 

7. Is it necessary for learners to be able to formulate, ask, Yes No 
and have a response to their own constructed questions? 

8. Would It be advantageous to diminish reliance on Yes No 
expensive, scarce, or hazardous equipment used in the 

practice of procedures for instructional purposes? 

9. Would a gaming environment Increase student motivation Yes No 
in learning an otherwise dull or repetitive task? 

10. Do students need intensive practice in recall or recognition Yes No 
of factual or procedural information? 

II. Is it crucial to be able to diagnose a student's faulty yes No 
reasoning/ misunderstanding and use the diagnosis to guide 

and drect further instruction? 

12* Do students need to be able to generalize what has been Yes No 
learned to problems that are dissimilar from the example 
problems already demonstrated? 
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ft™- 



13. Woutd it be particularly advantageous to olminish the time Yes No 
required to sain relevant practice? 

14. Should the students participate in defining the instructional Yes No 
objectives, the instructional content and the order of 
presentation? 

15. Does the student need an opportunity to practice Yes No 
procedures or solve problems in realistic situations? 

16. Is there a large body of organized information that Yes No 
students could profit from by browsing through at their 

own discretion? 

17. Are there many ways to execute procedures or solve a Yes No 
given problem? 

18. Is it possible to anticipate a small number of incorrect Yes No 
responses to typical instructional questions? 
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Decision Aid 4 
Worksheet 4Bj CAI Methods Identification* 



Circle question numbers you answered "Yes" to on Worksheet 4A and note the suggested CAI methodfc). 



Informational 


Dril i-ano-r racu ce 


1 Ulurlai 


vi am ingf m cs iiui i 


Innnirv 


ICAI 


1 


4 


3 


8 


2 


7 


6 


10 




9 


14 


11 


16 


12 


18 


13 












15 










17 









•See Section H.D. for a discussion of the characteristics of each of these CAI applications. 
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H. Decision Aid 5: Determine CAI Design Features 
Required for Targeted Instruction 



At this point in the adoption decision process, there should be an early 
determination of the types of CAI required to meet the instructional objectives. 
The next task is to determine the primary features or capabilities needed to 
support both the instructional content and the requirements of the chosen CAI 
methods. 

The cost of both hardware and specialized CAI software will be directly 
related to the type and number of CAI features needing support. Also, if a 
particular feature is not supported by an authoring language or system, a special 
program code in a higher order language to support that feature may need to be 
developed. This can impact both the cost and schedule for developing effective 
CAI materials which require the desired feature. 

For simplicity, the features needed in a CAI system can be placed in 
three categories presentation features, control features, and authoring features. 
Presentation features will be determined most by the characteristics of the 
content of the proposed Instruction (i.e., text-oriented versus graphics-oriented). 
Control features will be determined most by the Instructional method to be 
employed. Authoring features will be determined most by the experience level of 
the development staff and the quantity of courseware to be produced. 

The following worksheet contains a list of both hardware and software 
features that either may be required or would be found desirable in a CAI system. 
The number and type of features chosen will directly Impact the overall cost of 
the CAI system. This impact on cost can be either positive or negative. More 
features usually mean a greater cost for either the hardware or the software or 
both. However, some feature*, such as those for authoring, can reduce the 
support costs. When features are selected, the amount of CAI needed initially and 
the potential for expansion must be considered. Expansion to a larger system is 
always possible. Such an approach will avoid the need to purchase features that 
may not be necessary right now and will enable future needs to be met with more 
up-to-date technology. Often it is best to look at adopting CAI on an 
evolutionary or incremental basisf therefore, CAI features should be selected 
judiciously. 

The issue for decision In this handbook is focused entirely on CAI) 
student and course record- keeping capabilities, characteristic of CM! systems, 
are not included. However, it may be desirable to look for a CAI system that has 
the ability to support some of these features. 
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Decision Aid 5 
Worksheet: CA1 Design Features 



System Features 



Need (check one) 
Yes No 



1. Presentation Features 
Text 

Alternate Character 
Fonts 



User-Defined 
Character Sets 



Highlighting - 
Colo*, Underlining, 
Blinking, or Reverse 
Image 



"Windows" and 
Selective Erase 



Graphic Text 



Sizing and Rotation 



Comments 



The ASCII standard character 
set is the basic capability re- 
quired. An alternate character 
set such as for scientific nota- 
tion or for a language such as 
Russian would be needed for 
specialized instruction. 

This feature is often combined 
with the graphic capabilities of 
the system. It provides for 
establishing peculiar symbols or 
figures (e.g., electronic sche- 
matic symbols). 

These features are typically 
desired for emphasizing par- 
ticular content. Color is more 
expensive and often is not really 
needed. 

These features are useful when 
it is desired to elaborate on a 
single concept. A statement of 
the concept or rule can be made 
at the top portion of the display 
while the bottom portion of the 
display proceeds imcrementally 
through various examples. 

This feature is needed when it is 
desirable to manipulate the text 
in a variety of ways, such as 
creating dif-ferent sizes of text 
within a particular font. 

These features are required 
when labeling of graphs or titling 
is needed. 
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System Features 



Need (check one) 
Yes No 



Comments 



Integrated Text and 
Graphics 



Graphics 

Character Graphics 



Vector Graphics 



Animation 



Video 



Graphic-Video Overlay 



This feature is especially 
important where the instruction 
requires a concept or object to 
be simultaneously explained and 
illustrated with different parts 
of the text corresponding to 
different portions of the 
illustration. 



This feature is sufficient for 
low- resolution images or where 
the graphic objects are basically 
static and can be composed of 
one or more defined character 
units. Illustrating a tool such as 
a hammer would be an example. 

This feature is typically needed 
for high-resolution images, 
especially if diagonal and curved 
lines are frequently used. 

This feature is needed for 
illustrating dynamic sequences. 

Access to a video Input is 
important when real- world 
images or motion sequences are 
important to the instruction. 

This feature allows one to 
emphasize or enhance a video 
image played from either a video 
tape or video disk with 
computer- generated graphics. 
This would* for example, permit 
a video Image of a meter dial to 
be enhanced with the animated 
graphic image of the meter 
needle as a consequence of some 
learner input. 



132 

143 



System Features 



Need (check 
Yes No 



Comments 



2. Control Features 
Learner Input Mode 

Keyboard 

Touch (screen panel or 
lightpen) 



Joystick, Mouse or 
Paddle 



Sequencing-Program 
Control 

Linear-Next Frame 



Author-Flagged Branch 



Data-Oriven Branch 



This is a minimum requirement. 

This feature is useful when it is 
believed that learners would 
have difficulty using the 
keyboard or when a majority of 
the instruction requires the 
learner to make visual 
identifications of parts of a 
graphic or video image. 

This feature is useful when it is 
desired that the learner control 
the movement of objects in th. 
display. 



This feature has the simplest 
control logic and is useful for 
the presentation of basic 
informational sequences or the 
sequential presentation of drill- 
and-practice items without re- 
mediation. 

This is the basic feature needed 
for conditional-type branching 
based on author-anticipated 
learner responses. It represents 
the minimum needed for drill- 
and-practice with remediation or 
tutorial instruction. 

This capability is needed for 
more sophisticated tutorial 
strategies that take Into account 
the learner's prior activities 
within the lesson. This 
capability is also essential to 
most forms of simulation. 
Branching Is made on the basis 
of a decision algorithm. 



133 



144 



System Features 



Need (check one) 
Yes No 



Comments 



Model-Based Branch 



Sequencing-Learner 

Menu-Driven Branch 



Question-Based Branch 



Answer Judging 

Key Word 



This i$ the basic capability 
necessary for intelligent CAI. 
The knowledge base underlying 
expertise is modeled as well as 
the ongoing performance of the 
learner. The sequence of 
instruction is unique to each 
learner. 



This is the basic capability 
needed to allow a learner to 
control the next display of 
information to be presented. It 
is frequently used for 
informational sequences in CAI 
and "Learner-Control," tutorial - 
type CAI wherein, for example, 
the learner can optionally choose 
the number of examples to be 
seen. 

This feature allows a learner to 
seek information in a question 
format. It requires that the 
system have a model Instruc- 
tional knowledge base for a 
subject and at least an ability to 
properly interpret highly 
structured questions. 



This minimum capability allows 
the judgment of multiple-choice 
questions and constructed- 
response questions consisting of 
single words or short phrases. It 
depends on an exact match 
between the expected response 
entered by the author and the 
actual response of the learner. 
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System Features 



Need (check one) 
Yes No 



Comments 



Screen Location 



Synonyms 



Spelling 



Multiword 



Natural Language 



This is a variation of the key 
word technique which allows the 
judgment of a location within 
the context of a display to be 
judged correct or incorrect. It is 
used with monkeyboard-type 
input devices and is usually 
important for simulation. 

This is an additional capability 
to the key word match that will 
allow several forms of a 
learner's response to be judged 
correct. It evaluates only those 
words or phrases that are 
explicitly entered by the author. 

This is an addition to the key 
word technique which permits 
close spellings of the target 
word to be accepted as correct. 

This capability allows the 
judging of long phrases or 
complete sentences. This capa- 
bility typically Includes the 
ability to accept changes in word 
order and the possibility to 
ignore punctuation and/or capi- 
talization. This Is usually 
Important for more sophisticated 
levels of tutorial CAI and 
represents a minimum capability 
for inquiry-based CAI. 

This Is a capability to accept and 
judge any learner Input that 
represents normal usage oil the 
learner's native language. All 
possible conditions for any 
particular response do net have 
to be explicitly entered by the 
authon rather, processing Is 
bated on a model of the 
knowledge base for a subject. 
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mW y to 



System Features 



Need (check one) 
Yes No 



Comments 



3. Authoring Features 
Display 
Display At 



Specified Graphic 
Objects 



Bit-Pad or Cursor- 
Controlled Graphic Input 



Object Manipulation 



Editing Text 



Editing Graphic 



Copy 



This feature allows designation 
of a screen location at which the 
presentation of either text or 
graphic will start. 

These are commands or menu 
items which allow the author to 
easily create graphic objects 
such as lines, boxes (frames), 
circles, curves, etc* 

This feature allows the creation 
of a graphic by the movement of 
a pen on an electronic pad or by 
the use of special keys to move a 
cursor around on the screen. 

This provides a capability to 
treat a unit of text or a graphic 
as a single object and to move it 
around in "real time." 

The provision of text editing 
allows at least the insertion and 
deletion of characters and/or 
words. 

The provision of editing features 
allows the modification of a 
created graphic in "real time." 

This feature provides the ability 
to designate and transfer a text 
or graphic object from one part 
of a lesson to another part or 
from a different lesson. 
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System Features 



Need (check one) 
Yes No 



Comments 



Library 



Abort 

Control 

Branch Commands 



Control Menus 



Learner Input 

Judge Commands 



Response Menus 



Function Keys 



Screen Location 



137 



This feature provides the ability 
to place frequently used graphic 
objects into a storage file from 
which they can be called into use 
within different lessons. 

This provides the capability ti 
cancel modifications to a lesson. 



These are specialized commands 
which permit the designation of 
the next lesson segment based on 
learner input (e.g., jump, next, 
go td). 

This feature provides menus 
designating the possible control 
options for a particular segment 
of instruction. The author 
controls the sequence by setting 
flags or entering parameter 
values. 



These are specialized commands 
which allow the author to 
designate correct and incorrect 
choices. 

This feature provides menus 
listing possible judgment options 
such as ignore spelling, 
acceptable synonyms, etc. 

The author can designate 
specific keys to represent 
possible control options that the 
learner can exercise on a 
uniform basis throughout the 
lesson fctg., help). 

Commands or menu options 
permit the author to designate 
screen locations as an 
acceptable response input by the 
learner. 
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L Does CAlCp>bii[ty Currently Exist 



If a CAI capability currently does exist or a mechanism has been 
established whereby a capability is available to your organization, you will need to 
know If it is adequate for your organizational requirements and the CAI design 
feature requirements defined by you in Decision Aid 5. 

PROCEED TO DECISION AID 6t 

"3. Record Availability of CAI Features and Capabilities" 



If a CAI capability does not exist or if a capability has not been made 
available to your training organization, then you will need to define your 
requirements so adequate capability can be justified and procured. 

K. Use Decision Aid J as a "shopping list" for needed CAI capabilities. 



THEN PROCEED TO DECISION AID 7i 
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3. Deciiion Aid it gec ?-d 
AvalUMUW 01 CAI fmm «nd C^btllto 



1! a specific training organization has, or has access to, a CAI capability, 
it musit be determined if the required CAI features specified on the Decision Aid 5 
worksheet are supported. 

Decision Aid 6 requires that ail "yes" responses be transposed from 
Decision Aid 5 and then the availability of these features be assessed. The 
completion of this decision aid will also aid in subsequent discussions with 
vendors. 



AFTER YOU COMPLETE DECISION AID 6, 
PROCEED TO SECTION L, DECISION AID 7i ESTIMATE COSTS OF CAI. 



(You may find that some of the issues raised in Sections N, O, and P 
relating to organizational accommodations and responses to change are less 
relevant in your situation than the situation in which CAI is not already available. 
However, we suggest that you work through these sections as well.) 
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Decision Aid 6 
Worksheet! Availability of CAI Design Features 



Need 

(from Decision Available 

System Features Aid ») Yes No 

1. Presentation Features 
Text 

Alternate Character Fonts 

User* Defined Character Sets 

Highlighting - Color, Underlining, 

Blinking, or Reverse Image 

"Windows" and Selective Erase 

Graphic Text 

Sizing and Rotation 

Integrated Text and Graphics 

Graphics 

Character Graphics 

Vector Graphics 

Animation 

Video 

Graphic-Video Overlay 

2. Control Features 
Leanrcr Input Mode 

Keyboard 

Touch (screen panel or lifhtpen) _ 

Joystick, Mouse, or Paddle 
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nccki 

Sv«*»m e. a *,™ ^ ,rom Decision Available 

System Features , Aid ») Yes No 

Setfjencing-Progrwn Control 
Linear-Next Frame 
Author-Flagged Branch 
Data-Driven Branch 
Model-Based Branch 



Menu-Driven Branch 
Question-Based Branch 
Answer Judging 

Key Word 
Screen Location 
Synonyms 
Spelling 
Multiword 
Natural Language 

3. Authoring Features 
Display 
Display At 

Specified Graphic Objects 

Bit-Pad or Cursor-Controlled Graphic Input 

Object Manipulation 
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System Features 



Need 

(from Decision Available 
Aid ») Yes No 



Editing Text 
Editing Graphic 
Copy 
Library 
Abort 

Control 

Branch Commands 
Control Menus 

Learner Input 
Judge Commands 
Response Menus 
Function Keys 
Screen Location 
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J° t ProP«rly determine the com of using CAI, a great number of 
individual factors need to be considered. This worksheet is not intended to 
provide a detailed cost model for CAL Rather, each set of items on the 
worksheet is included only to ensure thai all major cost areas have been evaluated 
prior to making an adoption decision. 

. . * •■timatlni the costs associated with employing CAI, most likely valid 
data will be available for only a few cost categories hardware). Detailed 
cost figures for existing training operations are likely to be sparse or missing 
altogether. Therefore, the cost analysis should Include careful documentation of 
all the assumptions made in arriving at useable estimates for each of the specified 
cost areas on the worksheet. Quite often it will be better simply to provide 
percentage figures (l*., 20% less faculties) rather than try to calculate exact 
dollars, since such figures can vary based on different estimating procedures. 

The material on the following pages can be used in two ways. If cost is 
an overriding issue, work through each step of the decision aid. If cost is only of 
general interest at this time because of the availability of hardware or other 
reasons, Decision Aid 7 should be used to review elements that contribute to 
costs. In any case, the results of completing the following worksheet (Decision 
Aid 7) will provide a broad perspective on the major costs involved in using CAI. 
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Decision Aid 7t 
Worksheet! Cost Estimation 

To develop a "ballpark 1 * estimate of the cost of implementing a CAI 
system, at least three major categories of cost should be considered! hardware 
and software, courseware production, and support. 

The following sections of this worksheet are designed to guide you in 
estimating these categories. Whenever possible, the estimates entered on this 
worksheet should be derived from available records and documentation, as well as 
discussions with vendors and instructors. It is likely that some estimates will 
reflect your best guess. Remember, however, that the accuracy of your overall 
cost estimate will, In large part, depend on the accuracy and completeness of your 
individual estimates for each cost factor considered. 

Section A. Estimation of Hardware and Software Costs 

In order to estimate computer system-related cost, it is necessary to 
determine the capacity, configuration, and capability of the computer that 
will be required. 

1. To consider the cost associated with system configuration and size 
required to accommodate the anticipated CAI training environment: 

la. Estimate the total amount of student contact time for CAI. First, 
estimate the number of CAI course hours. Second, estimate the 
total number of students who will go through the course during the 
period of time indicated in la. 

hrs X h££ (1) 

# of course hours # of students who Total student-CAI 
to be implemented wili take CAI contact time 

in CAI 

lb. Estimate the total amount of time CAI will be made available. 
First, provide the total period of CAI usage, in days. This period of 
usage can be an entire year for a course taught continuously or it 
can be a few weeks for courses taught periodically. Second, provide 
the amount of hours per day that CAI will be supported. As an 
example this figure might be 6 hours or 12 hours (more than one 
shift). 

days X hrs/dav = hrs (2) 

Period of time Hours of CAI Total hours of 

CAI is to be usage per day availability 

available 

lc. Estimate the number of student stations required. 

# _ * (3) 

Enter (1) Enter (2) # of student 

stations required 
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Id. If the number of student stations required (3) is less than 15, base 
your hardware costs on the use of stand-alone microcomputers (see 
Sections ML&3.1 and IU.B.4.1 J). 

If the number of student stations required (3) is greater than 15 but 
less than 6*, base your costs on the use of a supermicrocomputer or 
a minicomputer configured either as a central or modular system 
(see Sections III. B, 1.1 and IH.B.2.1). 

If the number of student stations required (3) is greater than 6*, 
base your costs on a centralized system configuration using a 
mainframe computer or a networked system of local processors See 
Sections IH.B.1.1 and III.B.4.1.2). 

To consider the costs associated with the required storage capacity: 

2a. First, estimate the text characters in existing printed instructional 
materials which will be converted to CAI. The following guidelines 
can be used for this estimation. 



1 typed single- spaced page 3,600 characters 

1 typed double-spaced page 1 ,800 characters 



# of text pages # of characters Total # text 

per page characters for 

conversion 



2b. Second, estimate the number of text characters mat will be 
contained in newly developed CAI displays. The following guidelines 
can be used for this estimation. 

1 7k -line x 80-character CRT screen 1 , 152 characters 
1 2* -line x *0-character CRT screen 576 characters 
(Based on 60% of full screen capacity) 

, X ( 5 ) 

# of displays # of characters Total # of new 

per display text characters 

2c. Third, estimate the amount of storage for graphics content. 

When graphics are combined with text, use the following 
guidelines: 

If screen density Is 192 x 256 pixels, use a storage factor of 
250. 

If screen density is 240 x 560 pixels, use a storage factor of 
500. 

#of graphic and Storage factor Storage for ^ 
text displays partial graphics 
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For full-screen graphic caspiays use the following guidelines! 

U screen ctanrtty is 192 x 2* pixel*, tMt a storage **ctor of too. 

If tcrttn eternity it 240 x 560 pixels, um a storage factor of 1,600. 

X m (7) 

f of full graphic Storage factor Storage for 
displays partial graphics 

2d. Calculate total storage requirements for text and graphics 

♦ ♦ + (s) 

Enter M Enter (A Enter {6} Enter V) Total bytes 

2e. Calculate the approximate external storage required In megabyte*. 

x .000001 ) ♦ ( x .4 ) « (9) 

_ ter Conversion Enter Factor Total 
($) to (8) for megabytes 

megabytes control of storage 

and required 
student data 
storage 

21. If the required storage space from equation (9) is between 1 and 4 
megabytes, memory storage costs can be based on the use of 5 H" or 
8" flexible disks. 

If the required storage space (9) Is greater than 4 megabytes, base 
your memory storage cost estimate on the use of hard disk units. If 
a stand-alone system configuration is to be used, consider the cost 
of a shared data network (see Section IILB.4.4.3). 

3. To consider the cost of acquiring the required authoring system (|), refer 
to Sections III.C.1, C.2, and C3. 

4. To consider the cost of communication hardware required, refer to 
Section 11LB.4.4. 

5. To consider the costs associated with other organizational issues, refer 
to Section IILB. Note that the above decision points are based on costs 
related to a single course or CAI application. The system configurations 
recommended are by no means absolute but rather, represent something 
which might be reasonably Independent of other organizational concerns. 

6. The selection of appropriate hardware and software should be based on 
(1) a review of the material indicated in steps id, 2f, 3, 4, and J above 
and (2) your own analysis from Section IILB* 
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7. After identifying the general type and capacity of the computer 
required, cost estimates should be obtained from appropriate vendors. 

$. Record your estimate of the total cost for hardware and software. 

S_ do) 

Total hardware and 
software cost 
estimate 

Section B. Estimation of Courseware Production Costs 

The development of CAI courseware may include (1) the conversion of 
traditional lock-step course materials, (2) the creation of CAI displays for 
materials not previously presented in a traoltional format, and (3) the 
development of complex CAI materials to support simulation, inquiry, or 
intelligent CAI. The following sections of this worksheet allow for the 
possibility that more than a single approach is likely in order to develop 
appropriate courseware. Further, the time involved in the development 
effort will vary significantly, depending on the software to be used. 

1. Estimate the number of hours required to translate existing instructional 
materials into instructional, drill-and-practice, and tutorial CAI 
materials using the matrix of weighting factors shown in Table 7B1. 

Table 7Bl a 

Weighting Factors: Instructional Materials to CAI Materials 



Type of Development Software 



Type of 
Instruction 


HOL 


Authoring 
Language 


Authoring 
System 


Informational 


100 


50 


25 


Drill-and- 
practice 


200 


100 


50 


Tutorial 


300 


150 


75 



Tn « values presented in Tables 7B1, 7B2 and 7B3 are based on the 
experience of the authors and the results of military CBI development projects 
(see Kearsiey, Hillelsohn, & Sei del, 1982* Lewis, et al. f 1980; and Oriansky ic 
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la. Estimate of time lor converting informational segments to CAI. 

# of hours of coo- Appropriate weight # of development 
ventional informs- factor (Table 7B1) hours for informa- 
tional instruction tional CA! 

_ X ■ (12) 

1 of hours of Appropriate weight # of development 

conventional factor (Table 7B1) hours for driil-and- 

drill-and-practice practice CAI 

lc. Estimate of time for converting tutorial segments to CAI. 

X . (13) 

# of hours of con- Appropriate weight # of development 
ventional tutorial factor (Table 7B1) hours for tutorial 
instruction instruction 

Id. Estimate total hours for converting conventional materials to CAI 
materials. 

♦ + » (14) 

Enter (11) Enter (12) Enter (13) Total hours for 

converting existing 
materials 

2. Estimate the number of hours required to create CAI displays for new 
instruction. For various types of CAI and development software, select 
the appropriate weighting factors from Table 7B2. 



Table 7B2 

Weighting Factors: Instructional Materials to CAI Displays 



Type of Development Software 



Type of Authoring Authoring 
Instruction HOL Language System 

Informational 1 «3 -25 

Drill-and- 2 1.0 .30 

practice 

Tutorial 3 1.3 .73 



148 



153 



2a. Estimate of time to create new informational CAIi 



1 of Informational Appropriate weight ioi development 
displays factor (Table 7B2) hours for informa- 

tional displays 

2b. Estimate of time to create new drill-and-practice CAI: 

# of driil-and- Appropriate weight I of development 
practice displays factor (Tabic 7B2) hours for drill-and- 
practice displays 

2c. Estimate of time to create new tutorial CAI: 

_. . X _» (17) 

# of tutorial Appropriate weight | of development 
displays factor (Table 7B2) hours for tutorial 

displays 

2d. Estimate total hours for creation of new CAI displays} 



Enter (15) Enter (16) Enter (17) Total hours for 

developing new 
CAI displays 



(18) 



The amount of development time for simulation-based CAI instruction is 
related to the degree of fidelity and the inclusiveness of coverage of the 
simulation. Increases in fidelity will usually be accompanied by a 
greater use of the graphic feature of the CAI system and increased 
requirements for the programming of specialized control algorithms. 

Classify the type of simulation to be developed, based on the following 
categories. The categories provided are a further refinement of the 
levels of simulation described in Section IU.D.4. 

- Equipment-Procedural! This is a simulation involving practice in the 
operation of a piece of equipment in accordance with specific 
procedural guidelines. 

- Equipment-Troubleshooting! This is a simulation involving the 
assessment of the operating condition of a piece of equipment 
followed by the ability to take a decision-based, manipulative action 
on the represented equipment. The options that are possible at any 
particular point in the simulation are typically constrained by the 
designed functionality of the piece of equipment. 

- Process-Decisions This is a simulation involving the capability to 
make decisions in real-time parameters as a function changes. The 
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decision made is context dependent, with a multiplicity of options 
being possible at each decision point. Examples of tMs type of 
simulation would typically involve medical or management 
simulations. 

3a. Having determined the number of hours of each type of simulation 
instruction to be developed, use the weighting factors «hown in 
Table 7B3 to estimate the total number of development hours 
required for CAI simulations. 

Table 7B3 

Weighting Factors: Instructional Materials to CAI Simulations 



Type of CAI 
Instruction 



HOL 



Tvpc of Development Software 



Authoring 
Language 



Authoring 
System 



Simulation 

Category a. 
Category b. 
Category c. 



250 
350 
*25 



125 
150 

2C0 



60 
75 
100 



# of hours 
Category A 



Appropriate weight # of development 
factor (Table 7B3) hours for Category 



(19) 



I of hours 
Category B 



# of hours 
Category C 



Enter (19) 



Appropriate weight 
factor (Table 7B3) 



Appropriate weight 
factor (Table 7B3) 



+ ♦ 
Enter "EoT" Enter (21) 



# of development 
hours for Category 
B 



# of development 
hours for Category 
C 



Total develop- 
ment hours for 
CAI simulations 



(20) 



(21) 



(22) 



3b. Estimate of time for other types of CAI materials 

Estimating the development time for inquiry- or ICAI-type instruc- 
tion is difficult because of the lack of a substantial experience base 
in these two areas of CAI (see Sections n.D.3 and .6). The 
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development factor for tht inquiry method of CAI should be bated 
on the relative comparison of its complexity to that of tutorial CAI. 
ICA! is still primarily a laboratory-based concept lacking extensive 
Implementation, Any application of ICA! should be undertaken only 
with an understanding of its risks and realization that the 
development will be contributing to the growth of a promising area 
of CAL The selection of weighting factors Is left to the user. 

♦ * (23) 

# of hours for # of hours for Total development 

developing Inquiry developing I CAI hours for other 
CAI materials CAI materials 

4« Estimate of the total number of hours required for CAI courseware 
development! 

♦ + » s (24) 

Enter (14) Enter (IS) Enter (22) Enter (23) Total # of 

CAI develop- 
ment hours 

5. The actual cost of CAI development will be related primarily to the cost 
of the personnel Involved. It Is recommended that a team approach be 
used. The team should consist of at least three individuals: instructional 
designer, subject matter-expert (SME), ami co**r or programmer. The 
actual design of a lesson involving primarily the instructional designer 
and the subject-matter expert is a constant in terms of the time 
required 0*., does not change significantly as a function of the software 
used unless a design system is empioyed). Thus, the front-end design 
involving the designers and the SME is a larger percentage of the overall 
development effort for an authoring system than for an HOL. Use 
percentage figures (shown in Table 7B4) to help distribute the 
development time among personnel. 

Table 7B4 

Development Time Distribution Table 



Type of Develooment Software 


Type of CAI 
Instruction 


HOL 


Authoring Authoring 
Lanauaee Svstem 


Front-end Design 
(designer and SME) 


.20 


.40 


.60 


Production 
(coder/program mer) 


.80 


.60 


.40 
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5a. Distribute development hours among team members* 

(25) 



Enter VM 


Appropriate per- 
centage of time 
for designer 
(Table 7M 

X 


# of hours for 
designer 


Enter (2« 


Appropriate per- 
centage of time 
for SME (Table 7B4) 


# of hours for 
SME 


Enter (2*) 


Appropriate per- 
centage of time 
for coder/pro- 
grammer (Table 
7B4) 


# of hours for 
coder/programmer 


Estimate personnel costs for courseware development* 

X 


Hourly rate for 
designer 


Enter (25) 

X 


Cost of designer 


Hourly rate for 
5 ME 


Enter (26) 

X 


Cost of SME 


Hourly rate for 
coder/ programmer 

■♦■ 


Enter (27) 


Cost of coder/ 
programmer 


Enter (&) Enter Enter (30) 


Total cost of 
personnel for 



(26) 



(27) 



courseware 
development 



(28) 



(29) 



(30) 



(31) 



Section C. Support Costs • 

Contrasted to costs that are peculiar to hardware ind software and CAI 
courseware development, there are general support costs associated with any 
instructional system which can vary as a function of the instructional 
methods or technology used. Such indirect costs include facilities, support 
personnel (can include instructor!), and maintenance. 
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1. Facility costs 



If your system hardware requirements have established the need for a 
computer processor and itt associated hardware which Is NOT a stand- 
alone or desk top unit, determine if a separate room or facility must be 
established for its operation. Also, determine additional classroom or 
laboratory facilities required. Such an additional facility would be a 
special learning center that would not normally be present in an existing 
instructional system. For a new course, it would be the classroom space 
over and above that which would be allocated for a more traditional 
instructional system. Additionally, specialized support equipment needs 
to be considered (special furniture, electrical distribution, etc X 

General yearly facility costs include rent or general support costs such 
as heat, light, building maintenance, etc. DO NOT include unless this is 
an added cost 0.e., rooms or facilities additional to those already being 
used for the existing instructional system or which would not be needed 
for a non-CAI system). Calculate the yearly general facility costs. 

Consider facility modification costs associated with special support 
systems that need to be added. Such support systems would include such 
things as air conditioning not already present or increased electrical 
requirements. Calculate the costs of modifying facilities for CAI. 

Evaluate if the use of CAI can result in reduced facilities (e.g., because 
of a reduction in instructional time). This figure should also include any 
reduction in the trainers, audio-visual aids, and actual job equipment 
that is used for instruction and which would be eliminated through the 
use of CAI. Calculate facility cost reduction as a result of adopting 
CAI. 

+ - - * (32) 

General Facility Facility cost Net facility 
facility modification reductions cost 

costs costs 

2. Operational Support Personnel 

This cost category includes the cost of personnel associated with the use 
of CAI during delivery of instruction (not the development of 
instruction). 

For instructional objectives for which CAI has been developed, the CAI 
lesson is the primary delivery mechanism. Thus, personnel that perform 
instructional monitoring or administrative functions SOLELY as a 
consequence of CAI usage should be costed as required support 
personnel. If instructor personnel would normally be required under an 
alternate instructional system and would be performing similar 
instructional monitoring or administrative functions, then their cost 
should not be associated with CAI. 

Consider special nomnstructional personnel (computer operators, system 
programmers, etc.) necessary for the daily operation of the CAI system. 
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CAS, through its ability to provide direct Instruction and to reduce 
instructional time, can either reduce the number oi personnel necessary 
to operate the instructional system op modify the typos of personnel 
needed (s«g«, rather than all instructors, a combination of instructors and 
Instructional aides might be used). 



Instructor/ Noninstruc- Support 

administrator tlonal sup- personnel 

personnel port person- reductions 
costs nel costs 

3. System Maintenance 

This category provides for costs associated with the maintenance of a 
CAI system. These maintenance costs are associated with activities that 
are required for the normal, daily operation of the system, as well as the 
periodic, long-term upkeep of the system. The latter type of 
maintenance includes items such as hardware repair and replacement and 
the revision of Instructional materials. Also, consider the following: 

Yearly, recurring communication costs such as telephone line rentals) 

Yearly cost of supply Items associated with the daily operation of the 
CAI system (such items might be computer paper, printer ribbons, floppy 
disks, etc.); 

Yearly cost of the maintenance contract^) for the main computer 
hardware and its peripherals; 

Yearly cost of the maintenance contract^) for the CAI software 
acquired. 

Estimate what percentage of the CAI courseware will be revised yearly. 
Multiply this percentage by the CAI development figure in part B.4, 
equation (24), of this decision aid. Using this percentage of development 
time and the personnel ratios in Table 7B4, figure the personnel costs for 
revising the CAI courseware. 

Because CAI courseware is self-contained within the system, it is 
possible that the maintenance cost for courseware (as compared to an 
existing system) can be reduced. Such a cost reduction might occur if 
such things as printing, graphics, and secretarial/clerical costs are 
avoided as a consequence of using CAI. Calculate possible maintenance 
cost reductions. 

♦ + + 

Communica- Supply costs Maintenance 
tion costs contracts 

(hardware) 



wet support 

personnel 

costs 



(33) 
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Maintenance Courseware Maintenance Net system 
contracts revision reductions maintenance 
(software) costs 



(3*) 



Total System Support Estimate 



♦ ♦ 
Enter (32) Enter (33) Enter (34) 



Net system 

support 

estimate 



(35) 



Section D. Total Cost Estimates 



Hardware Courseware System 

and software development support 

estimate estimate estimate 

(10) (31) (35) 



Total estimated 
CAI system 
costs 



(36) 
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M. Do Needs and Benefits Offset Costs? 



Decision Aids i, 2, and 3 identified potential benefits and the 
instructional and organizational factors that suggest either for or against the 
adoption of CAI. 

Worksheet 7 identified resources needed to support the CAI methods 
indicated by Decision Aids 4, 5, and 6, and provided a structure for estimating the 
costs associated with procuring and maintaining those resources. 

1. Do the promised benefits of CAI offset the costs? 

2. Is it likely that the required funding will be available? 

No decision aid or worksheet can quantify this process any further. 
However, by now the necessary information has been obtained (or the missing data 
have been identified) in order to make the adoption decision. A final worksheet 
(Decision Aid 8) focusing on the issue of change brings one additional factor to the 
decision. 



PROCEED TO DECISION AID 8: 
ORGANIZATIONAL ACCOMMODATION TO CHANGE 
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N. Decision Aid gi 
Organizational Accommodation to Change 



By this time the results of working with this handbook should have 
indicated either the need for further data and analysis or a growing conviction 
that CAI is (or is not) indicated. The question of change , however, rests on far 
more than technical considerations. The handbook has provided a variety of 
techniques for identifying and diagnosing critical factors and limitations of the 
training course or courses. Some conditions* such as uneven student flow or the 
increasing complexity of training content, indicate the need for some 
accommodation. However, the presence of problems and the identification of 
delivery-related causes do not necessarily indicate the wisdom of making 
immediate major system changes. 

The simultaneous integration of a new technology G-e., CAI) with 
changes to the training environment introduce new concerns and new 
requirements for users of the technology. 

An instructional technology that changes the existing training 
environment from one that is familiar and predominantly personal to one that 
requires considerable logistical planning, learning of new terminology and 
instructional approaches, and changing staff roles will, not unexpectedly, disrupt 
the existing organizational structure. A convincing demonstration of CAI's ability 
to make a significant positive impact on the training process may be required, 
suggesting the need for a phased approach. As has been stated in this handbook, a 
technological innovation that is only an element superimposed on a training 
system which remains substantially unmodified may contribute very little in 
exchange for the dislocation and adaptation required. The decision to adopt the 
new technology requires a realistic assessment of the system changes involved in 
its introduction and the willingness to make those changes welcome to those 
whom they impact. 

Change, then, is often a mixed blessing, involving both risk and expense. 
Change can have undesirable and unexpected consequences. Clearly, change is 
necessary if the current training approach is totally incapable of meeting training 
goals and requirements, but this is only infrequently the case. 

The following worksheet (Decision Aid 8) is designed to assist in 
determining the feasibility and advisability of initiating the adoption of CAI at 
this time . Should the results indicate that the conditions for successful adoption 
are not in place, then the items on the worksheet provide an indication of the 
kinds of support that need to be developed. 
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Decision Aid S 

Worksheet 8 As Assessment of Organizational Communication to Support CAI 



Rate your course or group of courses in terms of the following organizational questions: 



Consider your current organizational structure, would it 
currently: 

1. Support the ongoing communication* required for 
instructional development (among curriculum 
developers, ISDers, instructors, programmers, 
administrators, budget manage r|)? 

2. Support the ongoing communication required for 
instructional delivery (among administrators, course 
supervisors, instructors, curriculum developers, 
students)? 

3. Support the ongoing communication required for 
maintenance of CAI and hardware (among 
administrators, budget managers, instructors, 
curriculum developers)? 



Yes Probably No 



*ln a large organization, are there formal 
communication channels in place for systematic 
information exchange? If the organization is very small 
(less than 20 people), do the persons holding titles 
identified in each of the questions have opportunities for 
frequent discussions and informal information exchange? 



• If your answers to questions 1-3 are "No," the 
chances of CAI succeeding are low; communication 
and cooperation are vital in a successful CAI 
implementation 

• If your answers to questions 1-3 are "Probably," you 
must consider what changes are necessary and if 
there is realistic expectation for change. 

• If your answers to questions 1-3 are "Yes," the 
chances of CAI succeeding are enhanced. 



Decision Aid 3 

Worksheet SBs Assessment of Organization*! Support and Resistance 



Estimate probable support and resistance to the introduction of CAI by 
the following training-related p er s onn el It is not necessary to record these 
estimates, but you should make mental notes about levels of support and 
resistance* 

1. Top level management* 

2. Budget personnel 

3. Course/curriculum developers 



4. Course supervisors 

5. Instructors 



6. Students 



7. Others C«e., existing CAI development team, research staff, etc.) 



Items 1-5 have different relative weights in different organizations. 
Consider your organization and its key personnel: If resistance is rated "high" for 
those personnel, the chances of a successful CAI implementation are low. 
Flexibility and creativity are key organizational attributes in self-paced and CAI- 
based instruction. Low resistance to innovation is a related attribute. 



•Support at this level Is crucial. 
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O. Factors for Successful Transition to CAI 



The benefits of CAI have now been considered, as well as the 
instructional and organizational training needs relevant to CAI and the financial 
and human resources required to support CAI implementation. The handbook 
concludes by summarizing the factors usually required for successful transition to 
CAI* 

This handbook is intended to help its users make reasonable decisions 
about the possible adoption of CAI. It is not an implementation handbook. 
However, after completing the decision process, the following conditions must be 
put into place before a successful transition to CAI can be anticipated: 

1. A leader/advocate has been identified. 



2. Realistic planning has taken place, with sufficient 
budget allocations and an appropriate incremental 
demonstration phase, as necessary. 

3. Involvement of the persons who, at various levels, will be 
using the CAI system has been encouraged. 

Changing roles of staff and instructor personnel have 
been carefully defined, with a sensitivity to individuals' 
needs for creativity and flexibility in exercising these 
roles. 

5. Approaches and materials needed to train staff personnel 
in their new roles as well as in the capabilities and 
operation of the selected CAI system have been planned 
and prepared. 

6. A sufficient number of terminals to support training 
requirements and student flow are available. 

7. Attention has been given to human factors issues, 
including a concern for student and instructor comfort. 

8. Requirements for system storage, inventory, and 
maintenance have been specified and appropriate 
resources allocated to meet these requirements. 

9. Consideration has been given to noninstructional 
functions that could be handled by the CAI system, 
thereby ensuring maximum system usage. 

Closely related to the preceding conditions that can facilitate the 
implementation of CAI in a particular training environment is the concern with 
user acceptance and, more generally, the concept of organizational change. 
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Implementing any innovation in an ongoing organizational environment is 
essentially an exercise in organizational change. Personnel in the organization 
are required to "mi earn" old and familiar practices and to learn new ones. This 
process can often evoke anxiety, insecurity, and resistance on the part of most 
individuals involved. For these reasons, a conscious and deliberate effort must be 
made to plan effectively for the change and to incorporate strategies for 
enhancing user acceptance during the change process* 

A number of researchers concerned with organizational change and the 
effective implementation of new training systems agree that resistance will be 
less if system users have been allowed to participate in diagnosing the training 
problem and selecting the appropriate solution- -that is, if they feel the project is 
their own. This implies that an effective implementation strategy is one that 
helps users have meaningful input into the design, development, and evaluation of 
the system. The training manager responsible for making the decision of whether 
or not to implement CAI will need to make a special effort to include the user 
group to the greatest extent possible in both the decision and implementation 
process. The retraining of staff personnel in their new roles and responsibilities 
with the system is essential, but not sufficient. The successful implementation of 
a new technology and the system required to support it is dependent, in large part, 
on both appropriate staff indoctrination and involvement. The decision to adopt 
CAI at this time should depend to some extent on an assessment of whether the 
environment for change exists and on the abilities and willingness of the training 
manager and supervisors to address the organizational issues of implementing 
change. If the decision is made to adopt CAI, the first few pages of Section II 
should be reviewed at this time as a reminder for maximizing the potentials and 
minimizing the limitations of this powerful instructional tool. 
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V* RESOURCES 



A. Using Technical Assistance Effectively 



1! by this time, the commitment has been made to Introduce CAI into a 
particular environment, but all of the caveats and warnings related to the training 
introduction of change in general and to the introduction of CAI in particular 
seem to be somewhat overwhelming, the possibility of outside technical assistance 
(TA) should be considered. This handbook should provide sufficient guidelines to 
permit a decision regarding the adoption of CAI technology, if there is some 
doubt, after reviewing the decision aids, then technical assistance consultants can 
be of help in reviewing the decision process and outcomes, in assisting with the 
process of change or in providing s pedal courseware products once the decision is 
made to develop them. 

There are many experienced and competent consultants and contractors 
available to provide high quality assistance. However, in spite of good intentions 
on the part of both the providers and recipients of technical assistance, there are 
numerous instances of Disappointment with the results. Therefore, the following 
recommendations are made for working with outside services for general 
assistance in the decision or initiation processes and for specific product-related 
assistance. 



1. General Assistance in the Decision orln tiation Process 

Although naming a single point of contact (facilitator) will assist the TA 
provider with the logistics of a site visit, there are advantages to forming a 
committee. If one person interacts exclusively with a consultant, the consultant 
may get a one-sided view of the environment and also if the key person is 
transferred or leaves the site for other reasons, as is frequently the case, the 
information exchanged between the consultant and the staff person is lost to the 
group. Related to the need to preserve information is the following 
recommendation. 

Get a written report from the consultant. Oral briefings are useful and 
provide the opportunity for questions and dalogue, but some lasting evidence of 
the information exchange that can be reread at one's leisure is essential. 
Frequently TA recipients have complained that they thought they understood what 
the consultant was recommending when on-site, but in retrospect, they could not 
accurately reconstruct the advice. A recommendation that "sounded great at the 
time" suddenly seemed ethereal or too vague to implement or had a logical flaw 
that may be the result of Inaccurate memory. When paying for a consultants 
assistance, It is generally worthwhile to Invest the extra funds required for a 
detailed written report, with both recommendations and a discussion of the 
rationale on which they were based. 

The consultant's services can be Improved if a round of private individual 
conferences is set up with key people in the organization and if these associates 
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are guaranteed anonymity so that inc2vidual perceptions, opinions, and attitudes 
can be freely expressed without concern about attribution. Following the 
individual conferences, arrange for a group meeting so that each of the issues 
uncovered can be openly explored with ail parties. Good TA providers wW be able 
to re-express individual concerns as their own issues and in such a way that 
individuals are not identified overtly or by inference as having raised them. 
Frequently the mere presence of a neutral party can generate a less protective 
and more open and flexible attitude toward specific issues that are causing 
problems, particularly problems related to the introduction of change. 



2. Specific Product-Related Assistance such as Courseware 

In general there are distinct advantages to developing courseware in- 
house. First, the in- ho use staff is thoroughly familiar with the objectives and 
philosophy of the branch, the course, and its development. Therefore, there are 
none of the expensive orientation costs normally associated with start-up. 
Second, the internal team, because of intimate involvement will have a stake in 
assisting in the transition from development to implementation to utilization. 
However, there are several reasons why a consultant or contractor might be 
engaged for lesson development or course evaluation; for example, 

e The requirement for specialized knowledge that is not 
readily available in-house, and related to that, it may be 
less expensive to have the job performed outside than to 
build a courseware staff capability in-house. 

e A tight time schedule for development exists that an 
already overworked staff may not be able to meet 
effectively. 

When engaging a consultant-contractor for courseware, training 
evaluation, facility design, etc., as many in-house staff people as possible should 
be involved in the process in order to generate the advantages associated with 
internal development (e.g., broad-based knowledge and a stake in the outcomes) 
and to minimize the alienation and subsequent resistance often associated with 
"outside" development. 

As an example, for lesson development the consultant should go through 
the same needs assessment steps the training manager would take; i«e., develop 
familiarity with trainee background, training objectives, field requirements and 
availability of on-the-job training, past evaluations, instructor qualifications, 
physical and human resources for delivery and maintenance of instruction and a 
thorough understanding of the training environments and other demands placed on 
students and instructors during the training process. It is generally not sufficient 
to develop courseware based on Instructional System Development {jSSf, Specialty 
Training Standard (STS), and Plan of Instruction (POI) requirements alone and 
certainly not advisable during the "transition to CAP process where training 
tradition and instructor needs must be taken into account along with 
subject-matter and learning strategy expertise. 
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B. Glossary 



ACOUSTIC COUPLER MODEM 



Ada 



ADCIS 

AECT 

AEDS 

AERA 

AFHRL 

AFSC 

AI 



AIDES 

AIS 

APDS 

APT 

ARI 

ATC 

AUTHORING LANGUAGE 



A special type of modem which allows a 
standard telephone headset to be attached to a 
terminal to allow the transmission of data, 

A structured program language* The new 
standard DoD language designed for mission 
critical systems. Has its basis in PASCAL-like 
structure. (Not an acronym.) 

Association for Development of Computer- 
Based Instructional Systems. (See Section V.E.) 

Association for Educational Communications 
and Technology. (See Section V.E.) 

Association for Educational Data Systems. (See 
Section V.E.) 

American Educational Research Association. 
(See Section V.E.) 

Air Force Human Resources Laboratory. 

Air Force Specialty Code. 

Artificial intelligence is the study and 
application of what is known about human 
intelligent behavior to the development of 
machine (computer) systems that model 
intelligent behavior. 

Advanced Instructional Delivery and Evaluation 
System. (A DoD CBI effort.) 

Advanced Instructional System. 

Advanced Personnel Data System. 

Authoring Procedure for TICCIT. 

Army Research Institute* 

Air Training Command. 

Programming language with codes specifically 
designed to handle major courseware needs such 
as response judging. 
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AUTHORING SYSTEM 



BASIC 



BAUD RATE 



BIT 



BLTM5 
BYTE 



CAI 



CA1S 
CAL 
CASIMS 



Prepackaged courseware templates or menu- 
driven editors designed to help authors create 
courseware without elaborate programming. 

Beginner's All-Pur pose Symbolic Instruction 
Code. A general-purpose, higWevel language 
designed for teaching programming. Intended 
for interactive use, it Is intended to be simple 
to learn. BASIC is widely used on a variety of 
computers, especially minicomputers and 
microcomputers. 

An analog unit of measure for transmission 
rate. Baud is usually equated to the digital rate 
of transmission referred to as Bits Per Second 
(BPS). Information can be sent by the computer 
at speeds that typically range from 110 to 1,200 
baud, which translates to 10-120 characters per 
second. 

Smallest quantity of data. Bit, which Is a 
contraction of binary digit, refers to a number 
represented by either a 0 or 1. All the memory 
locations in a computer are identifrH by a 
binary number address. 

Base Leve! Training Management System. (A 
DoD CBI effort.) 

Group of bits usually operated on as a unit. 
Since a byte consisting of S bits is customarily 
required to define an alphanumeric character, 
the S-bit byte has become a de facto standard, 
although others were used. Computer memory 
and mass storage are measured in terms of 
bytes. The symbols K and M are used, 
respectively, to designate thousands and 
millions of bytes. 

Computer-Assisted Instruction. Instruction in 
which students interact with a computer; a 
variety of interactive instructional modes are 
used, including drill-and-practice, tutorial, 
dialog, simulations, and games. 

Computer-Assisted Instructional Simulation* 

Computer-Assisted Learning. 

Computer-Aided Instruction Study Management 
System. (A DoD CBI effort.) 
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CASS 



Course Authoring Support System. (Part of the 
Advanced Instructional System.) 



CAVi 

CBE 
CBESS 

CB1 
CBT 



CENTRAL MEMORY 



CENTRAL PROCESSOR 



CDT5 



CMI 



COBOL 



Computer-Assisted Video instruction. The 
application of computer technology with either 
video disk or video tape technology. 

Computer-Based Education. 

Computer-Based Educational Software System* 
(A DoD CBI effort.) 

Computer-Based Instruction. 

Computer-Based Training. Term used to 
describe instruction delivered by using a 
computer! includes computer-assisted or 
computer-managed instruction. 

Organized collection of storage elements in the 
central processing unit of a computer into 
which instructions and data consisting of binary 
digits can be deposited and from which 
information can be retrieved. Compare with 
mass storage and off-line storage. 

A unit of a computer that includes the circuits 
controlling the interpretation and execution of 
instructions. 

Computer-Directed Training System. (A DoD 
CBI effort.) 

Computer-Managed Instruction. Use of a 
computer to guide a student through an 
individualized instruction program. Learning 
activities may be satisfied independent of the 
computer. The computer performs many of the 
administrative tasks such as diagnosing student 
needs, prescribing learning activities, and 
evaluating student accomplishments* 

.Common Business Oriented Language. A 
business data processing language". 



COMMUNICATIONS PROTOCOL In a data communication network, the code 

standard that governs the priority and 
sequencing of data transmission. 
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CONFIGURATION CONTROL/ 
MANAGEMENT 



COURSEWARE 



CP/M 



CRT 



DARPA 
DATA BASE 



DA i A FILE 



DATA PACKETS 



DEDICATED/UNLOADED 
TELEPHONE LJNES 



A systems management process used to ensure 
thftt modifications made in either herd ware, 
software, or courseware are in accordance with 
system standards and are compatible with the 
operation of other system components. 

Computer-based curriculum materials. 
Contrasted with "hardware," which is the 
electromechanical equipment, and "software," 
which is the program for making the equipment 
perform in certain ways. 

Control Program for Microcomputers. A widely 
used operating system for microcomputers. 
CCP/M is a trademark of Digital Research IncO 

Cathode-Ray Tube (terminal). A device used as 
a computer terminal which contains a 
television-like screen for displaying data. Most 
CRT terminals also have a typewriter-like 
keyboard. 

Defense Advanced Research Projects Agency. 

Collection of information, organized for 
retrieval. Generally, it is implied that this 
information is available in computer-readable 
form for either on-line or off-line access. 
However, some data bases which have been 
generated by a computer exist only In hard- 
copy form. An example may be the individual 
personnel records formed into a personnel data 
base* 

A collection of related records treated as a 
unit. 

A collection of data bits transmitted as a single 
unit in a communications network. 

Dedicated telephone line is a voice-grade line 
which has been "conditioned 1 to limit distortion 
and noise. An unconditioned line Is one which 
provides only the normal bandwidth necessary 
for voice transmission. An unloaded line 
provides a higher bandwidth than the voice- 
grade, unconditioned line. 
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DIRECT CONNECT MODEM 



DISK DRIVE 



DOWNLOAD 



A modem which can be directly connected to 
the RS232C input/output part of a terminal or 
computer. 

A device consisting of a spindle on which a disk 
pack can be mounted for electronically storing 
data* 

To transmit data from one computer to another 
or from the central processor to a peripheral 
device. 



DOWNTIME 



DTIC 



DUMB TERMINAL 



EEMT 



EPC 



EXTERNAL MEMORY 



EXTERNAL STORAGE 



FILE MANAGEMENT 
CAPABILITY 



FLAT PANEL 



FLOPPY DISK 



Period of time during which the central 
processor is inoperable. 

Defense Technical Information Center. 

A terminal that acts as an input/ output device 
only. 

Electronic Equipment Maintenance Trainer. (A 
DoD CBI effort.) 

External Power Contactor. 

Memory storage which is not part of the central 
processing unit of a computer. 

Peripheral device for storage G.e., tape or 
disk). 

A software capability within the operating 
system of a computer which allows for the 
creation and manipulation of data files on an 
external storage medium. 

A display device using the excitation of a gas or 
a crystal matrix to produce an image rather 
tii an the scanning of a phosphorous coating by 
an electron beam. Referred to as flat panel 
display technology because the depth of the 
display device itself is usually no more than i 
or 2 inches. 

An oxide-coated plastic disk 5ft or 8 inches in 
diameter enclosed in a protective covering that 
can be used for magnetically storing data. 
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ERJC 



ISO 



FORTRAN 



GAMING 



HARD DISK (storage) 



HARDWARE 



HOL 



ICAI 



INTELLIGENT TERMINAL 



INTERNAL STORAGE 

IQI 

ISO 



FORm ula TRANsJating system. A computer 
program language developed in the 1950s, 
primarily used to express computer programs by 
arithmetic formulas. 

A technique in which the learner is presented 
situations Involving choices and risks. 
Generally the choices are made to resemble 
real-life situations and the players are 
"rewarded* for various decisions. 

An external memory storage device using a 
stacked series of magnetically coated, rigid 
metal disks. 

Physical equipment, as opposed to the computer 
program or method of use; e.g., mechanical, 
magnetic, electrical, or electronic devices. 

Higher Order Language. A computer language 
that permits an action actually requiring 
several steps inside the computer to be 
specified by a single command. An example is 
COBOL. Higher order languages permit the 
programmer to be more productive than do 
assembly languages or machine languages. 

Intelligent Computer-Assisted Instruction. 
Computer-based instructional dialogue based 
upon techniques in artificial intelligence. 

A terminal with the ability to process data 
using the electronic components within the 
terminal without the need to access the power 
of a large computer. 

Addressable storage directly controlled by the 
central processing unit of a digital computer. 

Instructional Quality Inventory. A curriculum 
evaluation and design tool. (See bibliography.) 

Instructional System Development. This U a 
methodology for organizing the process of 
developing instruction. ISO is based on general 
systems theory. 

Instructional Support System. (A DoD CBI 
effort.) 
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KILOBYTE 



LANGUAGE 



LCD 

MAINFRAME 
MAIN MEMORY 



MEGABYTE 
MEMORY CHIP 



MICROCOMPUTER 



MICROPROCESSOR 

MINICOMPUTER 
MODEM 

MOUSE 



The standard unit of memory. One kilobyte 
comprises 1,02* bytes* (An 8K heme computer 
stores 8,192 bytes of 65^36 bits.) 

A format that allows a programmer to 
communicate more efficiently with a computer 
where commands will give requested actions. 
(BASIC Is one such language.) 

Liquid Crystal Display. 

Large computer that is capable of processing 
large amounts of data at very fast speeds, with 
access to billions of characters of data. 

That computer memory that is directly 
accessible. In a microcomputer main memory 
is referred to as random access memory (RAM) 
or read only memory (ROM). 

One million bytes. 

A chip on which data are stored as electrical 
charges. 

Smallest category of computers. Microcomput- 
ers tend to be miniaturized, are often dedicated 
to performing simple tasks, and do not usually 
have much flexibility. Wrist watches and hand- 
held calculators are examples of the limited 
end of the scale. Personal computers which 
cost $10,000 represent the upper cost limit of 
these devices. 

The electronic components of an entire central 
processor unit created on a very small single 
silicon chip. 

Category of computer designed to offer a 
medium-sized computer at low cost. 

MOdulator -pE Mo dulator. A device that 
modulates signals transmitted over communica- 
tion facilities. 

An input device containing a ball-ilka element. 
When moved about a flat surface, the motion 
and direction of movement are transformed 
Into X-Y coordinates for the display cursor. 
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MULTIPLEXER 

MULTITASKING (COMPUTER) 
OPERATING SYSTEM 

NPRDC 
NSPI 

NTEC 
NTIS 

OPERATING SYSTEM 

PASCAL 

PASS 

PCD1-2 

PIXELS 
PLATO 
POI 

PROCESSING 
PROCESSING TIME 



An electronic device that allows several 
terminals to share a single communication line. 

The control software of a computer's central 
processor which permits the processing of more 
than a single program. 

Navy Personnel Research and Development 
Center. 

National Society for Performance and 
Instruction (Programmed Instruction). (See 
Section V.B.) 

Naval Training and Equipment Center. 

National Technical Information System 

Software which controls the execution of 
computer programs and which may provide 
scheduling, debugging, input/output control, 
accounting, compilation, storage assignment, 
data management, and related services. 

A programming language designed to make it 
easy to write programs using structured 
techniques. 

Professional Authoring Support System. (A 
courseware authoring system marketed by Bell 
and Howell.) 

PLATO Course Development. (A courseware 
authoring system marketed by Control Data 
Corporation.) 

A single point of illumination on a display 
device. 

Programmed Logic for Automated Teaching 
Operations. 

Plan of Instruction. 

A term referring to the internal operations of a 
computer processor. 

The amount of time it takes a computer 
processor to operate on a specified ..umber of 
instructions (units of computer code). 
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PROCESSOR 
RAM 

RF 
RGB 



RING NETWORK 

ROM 

SALT 

SELECTIVE ERASE 
SID 

SIZING 



SMART TERMINAL 



SME 

SOFTWARE 



The central hardware unit which performs the 
basic operations on bits of data. 

Random Access Memory. A type of storage in 
which data can be written into and read from 
the storage element. 

Radio Frequency. 

Red, Green, Blue— standing for the separate 
Input of the signals corresponding to the 
primary color "guns" in a color cathode-ray 
tube. 

A configuration of computers or peripherals are 
serially connected such that any unit can 
communicate directly with any other unit. 

Read Only Memory. A type of memory in 
which data can be read and used but cannot be 
altered. 

Society for Applied Learning Technology. (See 
Section V.E.) 

Refers to the ability to erase part of a screen 
display without affecting other portions of the 
same screen display. 

Simulation Development. (Part of the 
Advanced Instructional System. Marketed by 
McDonnell Douglas.) 

The process of determining how much central 
and external memory storage is required for a 
computer system to support the processing 
tasks required. 

A terminal that has the ability to process data 
and function as a computer in addition to being 
an input/output device for a mainframe 
computer. 

Subject-Matter Expert. 

Category of computer components which is 
restricted to instructions to the equipment 
(hardware). Typically, software can be divided 
into operating systems, computer languages, 
and application programs. 
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IS 



STAND-ALONE COMPUTER 

STAR NETWORK 
STS 

TERMINAL DRIVER 
T1CCIT 

TIME-SHARE 

T?R 

TPSS 

TRIM 

UPWARD COMPATIBLE 

VIDEO DISPLAY UNIT 

WISE 
WORD 



A self-contained computer system consisting of 
at least a central proc es sor , central memory, 
display device, and input device. Usually used 
to refer to a single-user, microcomputer-based 
system. 

A configuration of computers and/or 
peripherals in which a single computer controls 
the communication and data flow to the other 
units. 

Specialty Training Standard. 

A software program which governs the 
communication of a computer with a particular 
terminal or class of terminals. 

Time-shared, Interactive, Computer- 
Controlled, Information Television. (CAI 
system marketed by Hazel tine.) 

To use a device for two or more simultaneous 
purposes. 

Technical Personnel Requirements. 

Training and Performance Support System. 

Time Related Instructional Management 
(system). (A DoD CB1 effort.) 

Characteristic which allows programs written 
on a lower level of system configuration for a 
particular processor to operate without change 
on higher level configurations using the same 
processor. 

A part of a computer similar to that of a 
television where Information is placed on its 
screen. 

WI CAT's Interactive System for Education. 

A character string or a bit string considered as 
an entity. 
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technologies: A pilot study. Volume two of appendices containing case studies. 
Cambridge, MAs Author, July 1979. 

Avner, R. A. Internal evaluation of the PLATO system. Paper presented at the 
Association for the Development of Computer-Based Instructional Systems 
(ADCIS), Annual Conference, Wilmington, Delaware, February 21, 1977. 

Avner, R. A- Cost-effective applications of computer-based education. 
Educational Technology, 1978, 18, 24-25. 

Avner, R. A* Longitudinal studies in computer-based authoring. In H. F. 0*Neil, 
Jr. (Ed.), Issues in instructional system development. New York* Academic 
Press, 19791 

Avner, R. A., Moore, C ft Smith, 5. Active external control: A basis for 
superiority of CBI. Journal of Computer-Based Instruction, 1980, 6(4), 115- 
118. 

Reports the result, of a study designed to provide evidence that 
CBI is superior to other, less costly alternatives because it allows 
for active, individualized control over student interaction. 

Berkowitz, M., ft O'Neill, H. F. An annotated bibliography for instructional 
systems development (ARI-TR-426). Alexandria, VAi U.S. Army Research 
Institute for the Behavioral and Social Sciences, August 1979. (NT IS No. AD- 
AO 81 183) 

Lists instructional developme. resources relevant to the 
Intel-service Procedures for Instructional Systems Development 
Model (ISO). The documents are classified according to the 19 
block ISD model and summaries identify them as related to 
authoring aids, procedures, or techniques. 
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M i» Uarotei with computet*. Bedford, MAi Digital Equipmtnt 

Corporation, 19ml* 

Focuitt on the use of the computer as a Iteming device. The 
chapters of this book are based on papers written during 10 years 
of work at the Physics Computer Development Project and the 
Educational Technology Center at the University of California. 
Included are chapters on graphics, computer dialogs, issues of 
fitting applications into the classroom, producing computer-based 
learning materials, and future possibilities. 

Braby, R., et aL Handbook of format models for designers of technical 
uMt& No. Af>-Ali* 129) 6 

Brown. J, S., ft Bobrow 9 R. J. Applications of artificial intelligence techniques in 
maintenance training. In New concepts in maintenance trainers and 
performance aids (Tech. Rep. IH-255). Orlando, FL: Naval Training 
Equipment Center, October 1975. 

Brown, 3. 5., Rubinstein, R., ft Burton, R. Reactive learning environment for 
computer assisted electronics instruction (AFHRL-TR-76-4ff). Lowry Af6, 
COi Air Force Human Resources Laboratory, Technical Training Division, 
October 1976. (NT1S No. AD-AO 35 302) 

Describes the development of several new computer-based 
strategies for teaching troubleshooting principles to electronics 
technicians. The report documents an experiment in which those 
strategies are presented to students to determine their attitudes 
toward the techniques and whether the training resulted in 
improvement of their skills. Results show students responded 
favorably and their performance improved quantitatively and 
qualitatively. 

Bunderson, C. V. Authoring sys> ms versus authoring languages for 
instructional systems development! Implications for Department of 
Defense (ARI-TR-7S-AI0J. Alexandria, VAs Army Research institute 
for the Behavioral and Social Sciences, 1978. (NTlS No. AD-A071 082) 

One of a series of reports on the authoring process and computer- 
based instruction and artificial intelligence. Notes the distinction 
between authoring systems and authoring languages. Includes a 
discussion of the critical goals for effective authoring. These goals 
are reduced costs and maintaining or increasing the quality of the 
materials. Primary constraints to reaching these goals are high 
turnover of authoring personnel and the need for military authoring 
systems to fit into the ISO model. 
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CUffaretta, 1* 9* Omrt» C* 8^ Lefam, S. E., Sktopen, 3. A., ft W. W. 

Factors affecting instructor/student ratios for self-pact* instruction. 
Educational Technology, 1980, 20(12), 5-9. 

This article reports on research aimed at developing a model to 
assess the optimal use of instructional personnel for self-paced 
courses. Twenty-five self-paced courses at seven locations were 
investigated. Although specifically designed for the military, the 
article also describes the implications for nonmilitary eduction 
and training. 

Carbonell, 3. R. AI in CA1: An artificial intelligence approach to computer-aided 
instruction. IEEE Transactions on Man-Machine Systems. 1970, 111*), 190-202. 

Chambers, 3. A., ft Sprecher, J. W. Computer-rsslsted instruction! Current 
trends and critical issues. Communications of die Association for Computing 
Machinery. 1950, 23(6), 332^551 

Charters, W. W., ft Pellegrin, R. 3. Barriers to the innovation process: Four case 
studies of differentiated staffing. Educational Administration Quarterly, 
1973, 9, 3-U. 

Clayton, 3. S. Inhibitors to the application of technology. Educational 
Communications Technology Journal, 1979, Summer, 157-172. 

Cohen. S. A. Dilemmas in the use of learner respon sive delivery systems. Paper 
presented at the American Educational Research Association Annual Meeting, 
Los Angeles, April 16, 1981. 

Collins, A., ft Grignetti, M. Intelligent CA1 (BBN Rep. No. 3181). Cambridge, 
MA* Bolt, Bet anek, ft Newman, Inc., 1975. 

Dallman, B. E. Graphic simulation in maintena nce training— Training 
effectiveness at cost savings. Paper presented at the Association for the 
Development of Computer-Based Instructional Systems (ADCIS), Annual 
Conference, Vancouver, Canada, 1982. 

A discussion of Air Force-sponsored research in use of simulation 
for maintenance training. Simulation is described as a cost- 
effective alternative if the simulation matc hes the fidelity level 
requirements of the instruction or task. 

Dallman, B. DeLeo, P. J., Main, P. ft Giliman, D. C. Evaluation of 
PLATO IV in vehicle maintenance training (AFHRL-TR-77-59). Lowry 
AF6, c6s Air Force Human Resources Laboratory, Technical Training 
Division, November 1977. (NTS No. AD-A052 623) 

Documents an Air Force service test of the PLATO IV Computer- 
Based Educational System at Chanute Technical Training Center, 
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Chanute AFB, Illinois. Thirty-five computer-assisted instruction 

1™,-*^-^* Wf^t Jeering approximately 20 hours of 
instruction. The evaluation addressed six major areas. In the first 

2? , B £2 n 2Sj il , efl ? Ct ir ene * s » P^ATO-based version was 
2 most efficient of the four compared. A cost analysis 
demonstrated that the Chanute application of PLATO was not cost 
effective, but the potential exists for enhanced benefits. A study 
of instructional impact showed student and instructor attitudes to 
be, respectively, favorable and acceptable. The fourth area, 
SCS u deve, °P men t i found the team approach to be 

effective, but the lessons did not exploit the full potential of 

h.t«L 4. y .?* two areas, management and 

human factors considerations, revealed minor adjustments 
necessary to accommodate PLATO within the military technical 
training environment. 

Dm ^&£Fk, Cm F - A " * Wofiord, B. R. Final report Evaluatio n of 

jhe PLATO IV svstem in a mi l itary training ~wir,w ♦ Km g ^j^g 

Proving Grounds, MD; Author, June i$75. 

^'1'!?' CB f,. An exam ination of the case for computer-based 

instruction. Journal of Computer-Based Instruction. 1977, 4(1), 1-7. 

In this keynote address at the conference of the Association for the 
Development of Computer-Based Instructional Systems (A DC IS), 
ins^tfon S9CS U important usc °* computers in 

Deignan, G. M., Seager, B. R., Kimball, M., & Horowitz, N. S. Computer-ass isted. 
g^Sggmed text, and lectur* mo de, , erf in strun g in thr ee ^ggjjg 
courses* comparative evaluation f APUftl-TftJM.^ t ~»- y A eh TO 

SSSSfeS Lab ° r * t0ry ' TeChniCal Trainin « Divisi ™> **• MO. 

Evaluates the comparative effectiveness of instruction delivered 
by the three methods. An analysis of learners who differ in 
characteristics such as aptitude and motivation is included. 

D TSii *• T "torial instruction on a computer (Illinois Series on Educational 
Application of computers Mo. 6e). Urbana, it, Illinois University atV^l 

ReWSin^S EdUCato ' *™ *~ t 

Describes a tutorial lesson to give teachers a model for comparing 
and contrasting a variety of instances of such lessons and to aLdst 
them in developing a personal understanding of what constitutes a 
tutorial computer lesson. Three flow charts are provided as 
examples of tutorial-style episodes. 
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Dote, U. Designing instruction for i ntrinsic motfymtjoni A theorv-based 
iSraadu AfSr fKWH Vt 44 AmdatU for Educational communication 
wfocnjidogy, Annual Convortdon^owbrloim, IfTf. 

Mooting , Boston, April 1980. 

Education Wee*. The educational rovo' ^ lcn li not "in the chlos»i Educators must 
ymj^more^t^^iouKhtloss pool^qv from com puter software. Education 

Else!*, 3. E. (Ed.). Special issu* on microcomputers in education. Educational 
Technology. 1979. 19(10). 

The first section of this special Issue has four articles on the use of 
microcomputers in education. The second section features 
computer software needs and the third section is an information 
resource, including a glossary of terms, a list of manufacturers, 
and a list of people and centers working with micros in education. 

Ellington, H., AddtaaD, E., & Perdval, F. A handbook of game design. New Yorki 
Nichols Publishing Co., 1982. 

Ellis, 3. A., Wuifedc, W. H., & Fredericks, P. S. The instructional quality 
Inventory (2 vols.) (NPRDC-SR-79-2*). San DiegoTCAi Navy Personnel 
Research and Development Center, August 1979. 

Everett, 3. A., * Kizior, 3. W. What the tra ining manager should know about 
computer-based Instruction (CBD. Washington, DC: U.S. Department of 
Energy, The standing Committee on Research of the Interagency Advisory 
Group's Committee on Development and Training, June 1979. 

The report defines, describes, and discusses the advantages of and 
the resources needed to develop a CBI system. 

Pauley, F. E. When to use CAI in training. Tralnlng/HRD. 1981, January, 82-83. 

A brief explanation and list of five criteria for the effective use of 
CAI. 

Fletcher, 3. D. Modeling the learner in computer-assisted instruction. Journal of 
Computer-Based Instruction, 1975, !(*), 118-126. 

This article identifies and reviews four models so that CAI can be 
adapted IB individual learners. Those models are derived from four 
treats quantitative models of memory, regression models of 
performance, automation models of performance, and artificial 
intelligence. 
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tner » *** *• Important criteria to consider for evaluating instructional 
simulations. Paper presented at the Association lor the Development of 
Computer-Based Instructional Systems (ADCIS), Annual Conference, Western 
Washington University, Beilingham, Washington, 1980. 

This paper lists the advantages and disadvantages of computer 
simulations, as well as the criteria necessary for evaluating 
instructional simulations. 

Francis, L. Guidelines f o r establishing and managing a computer-based education 
site (Rep. No. 1-148). Urbana, IL: University of Illinois, Computer-Based 
Education Research Laboratory, October 1977. 

The three parts of this paper outline management guidelines: (1) 
questions to be asked by those establishing or managing a 
computer-based education site, (2) the selection and training of a 
staff for the site, and (3) a variety of other issues and 
recommendations. 

Frantini, R. C. A buyer's guide to computer-based instructional systems. 
Performance and Instruction Journal. 1981, 20, 17-20. 

An article that provides a framework for the selection of the best 
computer system to meet individual computer-based instruction 
needs. Shared muiti terminals, dedicated multiterminals, and 
stand-alone computer-based training systems are discussed. A 
series of questions designed to help the reader choose the proper 
system concludes the review. 

Freda, J. S. Army train ing technology transfer. A systems model (ARI-RR-1241). 
Alexandria, VAs Army Research Institute for the Behavioral and Social 
Sciences, July 1980. (ERIC Document Reproduction Service No. ED 201 828) 

Presents a framework for the establishment of an Army training 
technology transfer program and suggestions to improve the 
acceptance and use of training research products. This systems 
model uses a linear approach to describe the four steps of transfer. 
.1) analysis of requirements, (2) research, development, test, and 
evaluation, (3) dissemination of findings, and ft) institutionaliza- 
tion. Within these steps other specific issues of needs assessments, 
funding, and the transition from innovation to policy are 
considered. 

Freda, J. S., 4c Shields, J, L. An investigation of the adoption process In train ing 
technology transfer (ARI-TK-o*i). Alexandria, VAx Army Research Institute 
for the Behavioral and Social Sciences, June 1980. (NTI5 No. AD-A109 200) 

Examines the transfer of Army training technology from the 
researcher to the user. This study used the Training Extension 
Course (TEC). Two major findings were (1) acceptance of TEC 
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depends initially on internal sources of information and later on 
external sources, (2) the best pre<ictor of TEC use was prior 
familiarity with it. 

Frederick, F. X Guide to microcomputers. Washington, DCs Association for 
Educational Communications end Technology, 1980. 

A comprehensive guide to microcomputers and their use in 
education, this book provides names and addresses of companies 
and manufacturers for different models and the special features 
that are discussed. Chapters of special interest include those on 
subroutines in BASIC for answer processing in CAI, accessories, 
and microcomputers in management and instructional support 
applications. 

Gapie, R. M. Developments in learning psychology} Implications for instructional 
design; and effects of computer technology on instructional design and 
development. Educational Technology, 1982, 22(6), 11-13. 

An interview with Robert Cagne in which he discusses what is 
happening in the field of learning psychology. Dr Gagne»s 
comments and observations touch on the shift from behavior! st to 
cognitive learning psychology, the influence of this shift on 
instructional design, emerging technology, and the merging of 
expertise from the fields of instructional design and computers. 

Gagne, R. M., Reiser, R. A., & Larsen, 3. A learning- b a sed model for media 
selection: Description (Research product 81-25*}. Tallahassee, FU Florida 
State University, center for Educational Technology, March 1981. 

Gagne, R. M., Wager, W., & Rojas, A. Planning and authoring computer-assisted 
instruction lessons. Educational Technology, 1981, 21(9), 17-26. 

Proposes a system for planning and authoring lessons that might be 
used with the new generation of microcomputers and associated 
hardware. The system outlined includes defining CAI lessons (types 
of learning outcomes, planning steps of instruction), authoring CAI 
(drill-and-practice, simulations, and tutorial's), and guidelines for 
CAI authors. 

Hall, K. A. Computer-b i lled education. The best of ERIC. June 1976 - 
August 19W. Syrawjse, NYs ERIC Clearinghouse on Information 
Resources, 1980. (ERIC Document Reproduction Service No. ED 195 
288) 

A bibliography containing annotations of reports, reviews, 
conference proceedings, and Journal articles on computer-based 
education. This compilation is divided Into seven subject headingsi 
historical references, new technologies, new audiences, 
applications by various content areas, developmental efforts, 
research, and conference proceedings* 
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p - An authoring system lor on-the-job environments, in H. F. aNeii, 
f££ ffi** JwrtnictiaMl svtems oeveteoment. New York} Academic 

Hartman, J., ft Gamett, D. A. A structured approach to the develop ment of 
cc iter assisted Instructing Paper present ed at the Association for 
Et tionai Data Systems, Minneapolis, May 5-8, 1981. 

Outlines a structured approach that involves assessment of course 
goals and learner characteristics, analysis of tasks, selection of an 
instructional strategy, authoring techniques, and course testing. 

^^ alglr [nevltabmty of - vidcodisc in 

Hfckey, A. E. Computer-assisted instructio m A summary of research In select^ 
Princeton, NJt Educational Testing Service, January 1975. " 



areas. 



Summarizes research on the application of technology to 
operational training. Major topic areas and trends covered in this 
report include subject-matter structure and instructional 
strategies, simulation, artificial intelligence, trainee testing and 
system evaluation, and authoring. 

Himwich, H. A. (Ed.). Critique and summary of the Chanute AFB CBE 
project (MTC Rep. No. 1*). Uroana, kt University of Illinois, 
Computer-Based Education Research Laboratory, September 1977. 

^JSt"' * A comparison of the T1CC1T and PLATO IV systems in a military 
m^fr Urbana, IL* University of Illinois, Computer-Based Education 
Laboratory, October 1977. (ERIC Document Reproduction Service No. ED 152 

Hoffman, J. L., * Waters, K. Some effects of student personality on success with 
computer-assisted instruction. Educational Technology. 1982, 22(3), 20-21. 

Holmes, G. Computer-assisted instructiom A discussion of some of the issues for 
would-be un pie men tors. Educational Technology. 1982, 22(9), 7-13. 

Highlights some important questions regarding the implementation 
of a CAI facility. The basic question-why implement at all-is 
followed by a discussion of CAI effectiveness and increasing 
student motivation. Other questions included are costs; choosing a 
system* attitudes of administrators, teachers, and students role of 
CAI in the curriculum} and sources of courseware. 

^^ ^sftesg^a^ 81 fnr fduc * ion - trainini! ( * d eax 

House, E. R. The politics of educatio nal innovation. Berkeley: McCutchari, 197*. 
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Hymes, 3.1U,tHgm, 3. A-» ******* W. Method and media selection (Tech. 
Rep, 3). Orem, UT: Courseware, Inc., 1975. 

Jamison, IX* Suppes, P., & Weils, S. The effectiveness of alternative instructional 
media: A survey. Review of Educational Research. 1974, 1-61. 

Overview of the research on the effectiveness of the following 
alternative instructional media: traditional classroom instruction, 
instructional radio, instructional television, programmed 
instruction, and computer-assisted instruction. 

Kaptow, R. A description of basic author aids in an organized system for 
computer-assisted instruction (AR1-TR-73-A3). Alexandria, VA: Army 
Research Institute for the Behavioral and Social Sciences, 1978. (NTI5 No. 
AD-A070 13?) 

Provides details on a number of author aids that can be 
implemented in any organized system for CAL. A major premise of 
this paper is that the only system which can maximize author 
assistance is one which is organized along those lines from its 
inception and K a plow concludes that it is far less satisfactory to 
tack on author aids to an existing programming language. 

Kearsley, C. P. Some "facts" about CAI: 1976 in depth. Alberta, Canada: 
Alberta University, Division of Educational Research Services, 1976. (ERIC 
Document Reproduction Service No. ED 152 288) 

Presents information about the state-of-the-art in CA1 in 1976. 
This information takes the form of quantitative data on the number 
and average completion time of CA1 programs according to subject 
matter, author, language, instructional strategies, sources, and 
central processor. These data provide an overview of activity in 
CAI useful for educational planning and decision making. 

Kearsley, G. P. Instructional design in C AI. Alberta, Canada: Alberta 
University, Division of Educational Research Services, 1977. (ERIC 
Document Reproduction Service No. ED 152 293) 

A conceptual framework for Instructional design is introduced 
which includes three major components: task analysis (involving 
objectives, skills, and subject-matter structure), learner analysis 
(concerned with aged, population, and group characteristics), and 
means analysis (involving instructional strategies, techniques of 
evaluation and feedback, and media). An instructional design cycle 
is discussed which illustrates how these three components fit into 
an overall educational context. This framework is then used to 
consider the application of instructional design to CAI activities. 
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Keeraftey, C P. Some conceptual Issues in computer-assisted instruction. Journal 
of Comoutof-afffrt jmsaate W7t|jUJ>*-4*. 

A critics] analysis of the conceptual framework and design 
philosophies of CAI. Discovers that inadequate notions of 
individualized instruction theory, failure to assess CAI 
effectiveness, and other theoretical problems present greater 
problems to CAI success than economic and technical hurdles. 



Kearsley, CP., HUlefsohn, M. f & Seidei, R. Microcomputer-based training in 
business and industry! Present status and future prospects. Journal of 
Educational Technology Systems. 1981-32. 10(2). 10 1-1 

This article presents the results of a survey of microcomputer- 
based training systems. Of those using computers, 71 percent were 
using microcomputers. The major areas of use for computers in 
training were technical skills, programming/computer concepts, 
management/sales, administrative/clerical, and management. The 
two major types of use were simulation and problem/presentation 
tests. The trends that were revealed by the survey included video 
disks, video text, video conferencing, em bedded learning, and 
distributed education. 

Kto&t A. T. Impact of computer-based Instruction on attitudes of students and 
instructors; A review (AFHRL-TR-75-A1. Lawv AFR r rn» Air m,,™,» 

Resources Laboratory, Technical Training Division, May 1975. (NTIS No. AD- 
AO M 797) 

Examines tH evidence on whether contact with computer-based 
instruction leads to feelings of "depersonalization" or 
"dehumanization." The approach is to document investigations of 
attitudes toward CBI held by students and instructors before, 
during, and after exposure to CBI. Includes an assessment of the 
relevant literature. 

Knerr, B. W., & Nawrocki, L. H. The measurement of military attitudes toward 
computer-assisted instruction (ARI-RM-78-iai. Alexandria, VAs Army 
Research Institute for the Behavioral and Social Sciences. 1978. (NTIS No. 
AD-A077 966) 

Reviews the interest in student attitudes toward CAI and concludes 
that this interest, although long-standing, has not produced well- 
integrated or consistent results. This report notes the following 
reasons for this lack of integration and consistencyi (1) student 
attitudes are typically Incidental to research or evaluation plans, 
(2) there is little agreement on an operational definition of student 
attitudes, and (3) the measuring instruments are designed ad hoc. 
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3. A., KuUk, C. C, ft Cafaca* P. A. Effect! veriest of computer-based 
college teachings A meta-analysis of findings. Review of Educational 
Research. 1980, 5$*), 525-544. 

Integrates the findings from 59 independent evaluations of 
computer-based college teaching. The meta-analysis showed that 
CBI made sm*Jl but significant contributions to course 
achievement and small, but positive effects on the attitudes of the 
students. 

Leiblum, M. D. Organizing for computer-assisted learning. Educational 
Technology. 1979, 19(9), 7-10. 

This article discusses the components of deciding where to place 
computer-based training within an educational institution's 
structure and defines the staffing needs necessary. 

Levin, H. M., ft Woo, L. An evaluation of the costs of computer-assisted 
instruction (Rep. No. 80-B7). Stanford, CA: Stanford University, Institute for 
Research on Educational Finance and Governance, May 1980. 

Lewis, W. E., Lovelace, D. E., Mahany, R. W M ft Judd, W. A. Computer-assisted 
Instruction in the context of the advanced instructional systems Materials 
development procedures and system evaluation (AFHRL-TR -79-71). Lowry 
AFB, CO: Air Force Human Resources Laboratory, Technical Training 
Division, March 1980. (NTIS No. AD-A082 996) 

Reports on a project to design, develop, implement and evaluate an 
authoring system for cost-effective production of CAI materials. 
Describes an authoring procedures model and instruction on use of 
software tools. 

Lintz, L. M., Pesmell, R., ft Yasutake, J. Y. Integrated system test of the 
Advanced Instructional System (AIS) (AFHRL-TR-79-40). Lowry AFB, COi 
Air Force Human Resources Laboratory, Technical Training Division, 
December 1979. (NTIS No. AD-A081 854) 

This study was designed to provide quantitative answers regarding 
the training time reductions resulting from certain computer- 
managed instruction (CMI) functions of the AIS. The reliabilities 
of the CMI functions and of the AIS support systems (media, 
computer hardware, and software) were also investigated. 

Magidson, E. M. Student assessment of PLATOt What students like and dislike 
about CAI. Educational Technology. 1978, .18(8), 15-19. 

Reports a survey of students who had been exposed to CAI for at 
least one semester, ranging from 7 to 30 hours. The author used 20 
agree/disagree questions and two open ended categories. Students 
responded favorably to CAI using PLATO. The few problems 
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mentioned inducted f rut tration with computer failures, insufficient 
computer lesson space, terminal breakdowns, and difficulty 
operating terminals. 

Itelone, T. W. What makes things fun to learn? A study of intrinsically 
motivating compu ter games (Cognitive and Instructional 5ci»nf*»« S»rU< r B»p. 
rio. CE-7). Palo Alto, CA* Xerox, August 1980. 

McCombs, B. U, Bade, S. M., ft West, A. S. Self-paced instruction: Factors 
critical to imple mentation in Air Force technical training — a preliminary 
inquiry (AFHRL-TP-8*-23). Lowry AFB, COt Air Force Human Resources 
Laboratory, Training Systems Division, August 1984. 

McCombs, B. L-, ft Dobrovolny, J. U Theoretical definition of instructor role in 
computer-m anaged instruction (NpRDC-TN-40-lO). San Diego, CA: Navy 
Personnel Research and Development Center, March 1980. 

Summarizes the literature in the areas of theoretical frameworks 
for defining ideal instructor roles and existing CM! system 
functions and definitions of those roles. Two primary instructor 
roles are identified and five major categories of instructor 
functions are identified as directly supporting student learning. 

McGuire, C, Solomon, U, & Bashook, P. Construction and use of written 
simulations. New York: The Psychological Corporation, 1975. 

McManus, X C. Equipment comparability techniques used during early system 
design (AFHRL-TR-79-24). Wright-Patterson AFB, OH: Air Force Human 
Resources Laboratory, Advanced Systems Division. July 1979. (NTIS No. AD- 
A071 411) 

Presents a systematic study of the t, ate-of-the-art in comparing 
proposed equipment to existing opet-iional equipment. The study 
involved a review of the literature, interviews of personnel who 
perform comparability analysis, and the examination of 
comparability studies used in the past. 

Micheli, G. S., Morris, C. U, & Swope, W. M. Computer based instructional 
systcms~1985-1995. Orlando, FL: Training Analysis and Evaluation 
Croup, Chief of Naval Education and Training, 1980. (ERIC Document 
Reproduction Service No. ED 19* 052) 

Discusses developments in CBI and presents initiatives for the 
improvement of Navy instructional management in the 1985 to 
1995 time frame. The major categories of current CBI systems are 
examined in the context of their problems and capabilities! future 
fends ar# presented? and an economic assessment of Navy needs is 
provided, including projected technological capabilities in 
hardware, software, and courseware to satisfy those needs. 
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MUnar, &. 0» Patermjntog ^^ J^g^ °±J™^ r ?* m i 

Washington, DCS Office Of Personnel Management, Trawwig Rmvoi and 
Evaluation Division, Workforce Effectiveness and Development Group, 
October 1979. 

Mllner, S., & Wlhfterfer, A. M. How should computers be used In learning? 
Journal of Comouter-Based Instruction. 197*, 1(1), 7-12. 

Discusses three different classes of reasons for using computers in 
instruction. These three d&sses of reasons are reviewed in relation to 
corresponding kinds of computer applications, the level of computer 
capabilities used, and the educational benefits derived. 

Miuelt, A. U, & CaU-Himwidc, E. Analysis of Sheopard AFB computer-based 
education project (MTC Rep. No. 21). Urbana, ILt Computer-Based Education 
Research Laboratory, January 1978. 

Misaelt, A. U, Francis, L., CaU-Himwick, E., & Avner, R. A, Implementation and 
operation of computer-based education. Urbana, ILi University of Illinois, 
Computer-Based Education Research Laboratory, August 1980. (NTIS No. AD- 
A101 715) 

Provides an administrative overview of the findings from a 5-year 
longitudinal study of factors affecting implementation and 
operation of computer-based education in military settings. These 
findings are generallzable to academic and industrial training 
situations as well. An annotated list of the 2* detailed reports 
produced during the project is included. 

Montgomery, A. D., & Judd, W. A. Computer-assisted instruction in the context 
of the advanced instructional system; Authoring support software (AFHRL- 
TR-79-12). Lowry AFB, COj Air Force Human Resources Laboratory , 
Technical Training Division, December 1979, (NTIS No. AD-A0S1 071) 

Details the design, development, and implementation of computer 
software to support the cost-effective production of CAI within 
the context of the Advanced Instructional System (AIS). Software 
components detailed ai-e Authoring Editor, Presentation Program, 
Data Collection, arid Data Print. 

National Technical Information Service. Computer-aided instruction. September, 
19 79. December. 19S1 (Citations from the NTS Data Base). Springfield, VAt 
NTIS, January 1982. (nVi$ ffoV PUi-&6Uft) 

Reports on the use of computers in education, and the computer 
systems necessary, are cited. Topics include motivation, technical 
training, learning factors, and human factors engineering. This 
updated bibliography contains 338 citations. 

Navy Personnel Research and Development Center. Prospects fo r low-cost CBT< 
A forecast (SR-79-16). San Diego, CAj NPRDC, April 1979. 
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Office of T«dM o tag| Awwwt . A survey of computer technology (Working 
Paper No, 1). Washington, DCs Congress of the United States, September 



OWeU, H. F. Computer-based instruction: A state-of-the-art assessment. New 
York* Academic Press, I9SI. ~ 

Provides an intellectual framework for recent and future CBI 
research. Chapter 1 is a general introduction to CBI and provides 
an overview of the rest of the book. An idealized computer- 
managed instructional system, described in Chapter 2, provides a 
conceptual framework for the field of CBI. CBI hardware and 
software are summarized in Chapter 3; courseware developments 
are the focus of Chapter t. !n Chapters 5 and 6, learning 
strategies and evaluation are reviewed. Chapter 7 focuses on the 
management aspects of CBI projects. The final chapter is a 
discussion of CBI in Europe and Japan. 

Orlansky, 3. 9 & String, J. Cost-effectiveness of computer-based instruction in 
military training (IDA Paper-P-1375/. Arlington, VA: Institute for Defense 
Analysis, Science and Technology Division, April 1979. (ERIC Document 
Reproduction Service No. ED 195 227) 

Evaluates the cost effectiveness of conventional, individualized, 
computer-assisted, and computer-managed instruction. Concludes 
that students prefer CAI or CMI to conventional instruction, 
attitudes of instructors are unfavorable to CAI and CMI, 
individualized instruction (without computer support) saves student 
time, and little additional student time is saved when the same 
courses are given by CAI or CMI. Cost savings attributed to CAI 
and CMI are based on estimates of pay and allowances of students 
for time saved by these methods. 

Orlansky, 3., dc String, J. Computer-based instruction for military training. 
Defense Management Journal, 1981, Second Quarter. 

In the Department of Defense, the training budget is approximately 
$8.8 billion. This report emphasizes the need to train effectively 
while at the same time minimizing cost, by comparing 
individualized instruction, computer-assisted instruction, and 
com outer- managed instruction. 

Orlansky, 3., & String, J. Cost-effectiveness of maintenance simulators for 
military training! Final report. 6PA Paper-P-1568). Arlington. VAt Institute 
for Defense Analysis, August 1981. (ERIC Document Reproduction Service 
No. ED 212 254) 

Discusses the cost effectiveness of using maintenance simulators 
as opposed to actual equipment trainers. The study found 
simulators to be as effective as equipment in terms of student 
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achievement. In 7 of 11 cases, the cost of a simulator was 60 
percent fess than for actual equipment* Report cautions* however, 
that effectiveness was based on school achievement not on-the-job 
performance and cost figures are based on acquisition not life- 
cycle costs. 

Peters, R. D. Computer-based education and training functions* A summary. 
(NPRDC-TN -82-17). San Diego, CAt Navy Personnel Research and 
Development Center, May 1982. (NT1S No. AD A 1 15 734) 

Briefly describes the functions a computer can perform in 
educational and training settings and a taxonomy of these functions 
to facilitate an understanding of their interrelationships in a 
computer-based instructional system. It is intended for those 
involved with operational educational and training facilities in both 
armed services and civilian organizations. 

Plato, G. 3. The individual versus the computer. An examination of attitude 
problems and their impact on system development. Monterey, CAt Naval Post 
Graduate School, June 1931. 

Discusses the problem of negative attitudes toward computer 
systems and ways to cope with emotional reactions. The role of 
managers, computer professionals, system users, and social 
institutions in promoting positive experiences and attitudes is 
examined. 

Plocher, T. A., Miller, L. A., Gardner, 3. A., & Cronin, J. £. The feasibility and 
applications of a computer based system for electronic test equipment and 
basic electronics training* Final report for period 3uly 1976 - April 1977. 
Warminster, PA. Naval Air Development Center, 1977. 

Roblyer, M. D. Instructional design vs. authoring of courseware: Some crucial 
differences. Paper presented at the Association for Educational Data 
Systems, Minneapolis, May 5-8, 1981. 

Describes a courseware design model and systematic procedures 
for packages to facilitate efficient student learning. The 
differences between instructional design and authoring are pointed 
out. 

Sandrin, J. V. Readiness for individualization of instruction: A school climate 
assessment procedure . Arlington, VA. Educational Resources Information 
Clearinghouse, 1982. (ERIC Document Reproduction Service No. ED 214 254) 

To help assess a school's readiness for individualized instruction, 
the author devised the School Climate Assessment of Learning 
Environment (SCALE-D, a research instrument comprised of 30 
belief statements about aspects of individualized instruction. 
Informants respond to the belief statements on an attitude scale. 
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The instrument was tested and the author concludes that it is e 
viable instrument for detecting a positive school climate lor 
indiviotolization of instruction. 

Sayior, C Computer-based learnlng-A primer (unpublished working paper). 
Golden, COt Author, October 1981. 

Outlines in detail computer-managed learning (administrative, 
support, and management) and computer-assisted learning 
(delivery). 

Schulz, R. E. On-line authoring aids for developing test and instruction. In U. F. 
ONeil, Jr. (EdJ, Procedures for instructional systems development. New 
York: Academic Press, 1979. 

Schulz, R. E., Hibbits, N., Wagner, H., & Seldel, R. X On-line authoring aids for 
instructional design (HumRRO-FR-ED-77-24). Alexandria, VA: Human 
Resources Research Organization, July 1979. (NTIS No, AD-A075 466) 

Reports on a feasibility demonstration of on-line, query-based 
authoring aids for selected blocks of the Interservice Procedures 
for Instructional Systems Development (IPSD) model. The three 
levels of evaluation included evaluating existing IPISD materials, 
the newly developed authoring aids, and the instructional materials 
produced. 

Seidel, R. 3. Its 1930s Do yot* know where your computer is? Alexandria, VA: 
Human Resources Research Organization, 1980. feRIC Document 
Reproduction Service No. ED 190 059) 

Provides an evaluative framework to clarify the similarities and 
differences in five purposes for which a computer may be used to 
aid instruction. Each purpose implies its own method of evaluation 
and each has a different set of effectiveness measures that 
highlight its unique value. The first four involve adding new skills 
or knowledge to the instructional process, or what is called "value 
added" computer use; while the fifth deals directly with cost 
effectiveness. The five purposes are (1) computing opportunities- 
providing facilities for each school; (2) computer literacy—learning 
what "computer" means* (3) curriculum enhancement— attaining 
new objectives} (4) educational reform (e.g., high school education 
at home); and (?) cost effectiveness (e.g., comparison of two ways 
of learning English grammar). Measures of effectiveness for each 
of these purposes are discussed. 

Seidel, R. X, Hunter, 5., & Wagner, H. Tips for managing CAI projects. 
Educational Technology. 1978, 1$(4), 33-37. 
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Seidei, R. J. f ft Wagner, H. Cost-effectiveness specification lo r computer-based 

Vol. 2;AD-A081 81*, Vol. 3) 

This cost effectiveness specification is proposed to facilitate the 
purchase, monitoring, and evaluation of computer-based training 
systems. Provides a standardized structure for deriving and 
communicating training system costs in three volumes Volume 1 
is development; Volume 2 is procurement, and Volume 3 is 
operation and maintenance. Cost methodology quantifies total 
inputs required over system life cycle. Effectiveness measures 
include objectives achieved and time measures for criteria both 
within and at the end of the course. 

Seidei, R. X, A Wagner, H. Management. In H. F. ONeil, Jr. (Ed.), 
Computer-based instruction: A state-of-the-art assessment. New York* 
Academic Press, 1981. 

Describes some of the lessons that managers of CB1 systems have 
learned, with the hope that the mistakes made in the past will not 
be repeated. Begins with a general discussion of management in 
the context of different organizational structures and relates these 
structures to the complexities of projects involving instructional 
use of the computer. Examples of specific projects that illustrate 
how project purposes dictate staffing requirements and resources, 
types of management functions and the appropriate evaluation 
models to apply are presented. 

Shavelson, R. 3., & Winkler, J. D. Can implementation of computers be justified 
on cost-effectiveness grounds? (P-6781). Santa Monica, CA: RAND, June 
1982. 

Examines claims that technology can decrease educational costs 
and increase educational productivity. Finds these claims 
unwarranted based on a look at how most cost analyses are 
conducted. 

Shirer, D. U Computer systems for education! An evaluation. Tucson, AZ: 
University of Arizona, Computer-Based Instruction Laboratory, 1982. 

Evaluates computers for education and categorizes into four broad 
groups: hobby, personal/ professional, individual instruction 
stations, and centralized computer networks. Costs are compared 
as well as the advantages, features, and limitations of each group 
for educational use. 

Shirer, D. U Evaluation of computer-based instruction systems. Tucson, AZ: 
University of Arizona, Computer-Based Instruction Laboratory, 1982. 
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>t ^ W \^g^^ffl^ ^mouter-asslstad ol inttmctiy. Piper 

presented *t*tem*5m Conference on Computer-Based Education, 
Minneapolis, October 19*0. 

Speedier, J. ¥., ft Chambers, 3. A. Computer assisted instruction* Factors 
affecting courseware development. Journal of Computer-Based I nstruction. 
1980, 7(2), 17-37. 

Identifies factors related to the development of materials for 
computer-assisted instruction. Two studies were conducted with 
computer center directors at public institutions of higher education 
and those faculty members nominated as "heavy* 1 courseware 
developers. Opinions from both groups were obtained on similar 
factors relevant to courseware development. 

Steinkerdtner, R. E., Deignan, G. M. v Waters, B. K., ft DeLeo, P. 3. Computer 
assisted instruction in Air Force medical training! Preliminary findings 
(AFHRL-TR-77-17). Lowry AFB, CO: Air Force Human Resources 
Laboratory, Technical Training Division, May 1977. (NTIS No. AD-A043 630) 

Documents the procedures and findings from a study of the 
application of interactive terminals In medical training in the Air 
Force. This report of the first part of the study includes 
implementation conditions, student reactions, lessons learned, and 
cost data analyzed by health care scientists. 

Suppes, P. Current trends in computer-assisted instruction. In M. C. Yovits, 
(Ed.). Advances in computers (Vol. 18). New York: Academic Press, 1979. 

Tatsuolca, K. K., ft Missel t, A. L. (Eds.). Attitude and performance of mill* L 
students and instructor attitude in computer-based technical training (Mi C 
Report No. 23). Urban*, IL: University of Illinois, Computer-Based Education 
Research Laboratory, January 1978. (ERIC Document Reproduction Service 
No. ED 201 320) 

Assesses the effectiveness of the PLATO IV system in a military 
training environment. Focuses on student and instructor attitudes 
in four special purpose vehicle repairman courses and the 
relationship of these attitudes to achievement. Findings showed 
that a positive perception of effectiveness was associated with 
better achievement, but frustration and stress of learning led to 
less favorable results. 

Taylor, S. S. CREATEt A computer-based authoring curriculum. In H. F. O'Neil, 
3r. (Ed.). Issues in instructional system development. New Yorki Academic 
Press, 197*. 

U.S. Ak Forc e Manual. 30-2. Randolph AFB, TXi Air Training Command, 1979. 
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ittecon domestic and Internationa 
too* House Committee on Scienci 



logy. 95th Congress, First Session, House Report No. *7. 
Washington, DCs U. S. Government Printing Office, 1978. 

Van Metre, N. Computer-based instruction of the futures An electronic 
marketplace. Paper presented at the Symposium on Learning Technology for 
the 80s, Society for Applied Learning Technology, Warrenton, VA, 1981. 



Examines the reasons why computer-based training as developed 
and conceived in the 1970s has not experienced the expected 
implementation in the 1980s. The Implications for students and 
program managers and the future of computer-based training is 
discussed. 

Vinsonhaler, J. F., & Bass, R. K. Ten major studies of the evaluation of CA1 drill 
and practice (ISL Rep. No. 21). East L an sin,.. Mis Michigan State University, 
Information Systems Laboratory, August 197: 



4e 



Watson, P. A. The costs and economics of learning systems. Educational 
Technology Systems. 1977,6. 

Zim, K. L., & Bork, A. Aspects of effective authoring systems and assistance 
Recommendations for research and development (ARI-TR-7S-A9). Columbus ; 
OHs Army Research Institute, September 1978. (NTIS No. AD-A071 11*) 

f 

One of a series of papers on the authoring process and CBI, this 
paper provides a brief historical look at computer-based authoring 
systems, gives details of the contributions the computer has made 
in developing teaching materials, and outlines the important 
aspects of the authoring process. 
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D. Screen Print Examples of CAI and Selected CAI Systems 

In the following pages, actual screen prints of five different types of CAI 
have been included to illustrate what has been described in the other sections of 
this handbook. Intelligent CAI OCAJ) is not included in this collection of prints 
because it would of necessity be illustrated with static prints and the potential of 
this powerful tool would not be adequately demonstrated. Please refer to the 
bibliography for I CAI materials. 

The use of static paper versions of dynamic, interactive instruction 
makes it very difficult to fully portray the strengths of the medium, such as 
nonlinear sequencing, user control through the use of "HELP" sequences, 
animation, and the ability of a program to track an individual's progress and tailor 
the instructional sequence to the strengths or weaknesses previously displayed by 
the individual. These examples should, ho* -ver, provide some insight about the 
different uses of various CAI modes. 

Two CAI development and user organizations have generously agreed to 
allow their screen-printed CAI instructional sequences to be included in this 
handbook. (Appreciation for written permission is extended to McDonnell Douglas 
Astronautics Company and the United Airlines Flight Training Center). 

To aid in an adequate representation of the instruction, each screen print 
is annotated. These annotations appear on the page opposite the screen print. 
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Informational 



The next two displays give a very simple example of how informational 
CAI can be used during a tutorial, drill-and-practice, or simulation sequence. 

This display asks the student to answer a question for which the student 
is not expected to have all necessary information in memory. Specifically, the 
student must convert from inches to centimeters but is provided with the option 
to get that information on-line. 
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Given the -following trianglei 

A. 




fiff ■ 3 inches 
& ■ 4 laches 



What is the length of SE in centimeters? 



Press key "PF1" for conversion factor chart 

* 
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This display is the Informational CAI itself. It is an adjunct to 
instruction. Another example might have been the instructional screen as a form 
to fill out and the informational screen as the relationship governing the form. 
The information screen would be used, optionally, as reference. 
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Conversion Factor Chart 

The standard unit of linear measurement 
in the metric system is the meter. 

1 meter - 100 centimeters 
1 meter - 39.37 inches 
1 meter - 3.281 feet 



Press RETURN to continue 
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Drill-and-Practice 



Students for this brief instructional segment have been given instruction 
before seeing this screen about the Control Panel referred to on the screen. 

This screen focuses attention on one section of the panel while* at the 
same time, providing the context of the entire panel. 

After some explanation of the Bleed Air Control Switch, the student is 
given the opportunity to practice bleed air control as shown in the following 

illustrations. 
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Press BflCK to review 



The Bleed flir 
Control Switch 
is located 
in the lover 
right hand corner 
of the ECS 
Control Panel. 




Press NEXT to go on; C to comment on material. 

By permission of McDonnell Douglas Astronautics Company. 
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This screen depicts the effect caused by changes in the Air Bleed 
Control Switch. 

Note that the switch is in the OFF position; the valves reflect that 

position. 

In the original, color is used effectively to highlight the changes in the 
system when the switch is altered. For purposes of economy in printing this 
handbook, the use of color is represented by shading. 
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NORM 



L OFF 




RUG 
PULL 

-R OFF 



RIGHT E NGINE aarHMY 

PRESSURE 
REGULATING 
AND 



OFF' 

Continue to touch 
the other switch 
positions, noting 
the effect 
to the Primarg 
Regulating Valves. 



Remember that 
flUGHENTRTIOH PULL works 
onlH from the HORHfiL 
position on the Switch- apy 



l/LN 

EXT RIR 



RTB 




| "1 sHurorr 

J VftLVE 



s 




pRiriftRr 

PRESSURE 

REGULATING 

AND 

sHUTorr 

VALVE 



LEFT ENGINE 



By permission of McDonnell Douglas Astronautics Company 



213 



SELECT. 

214 



Note the change in valve positions as the student changes the position of 
the switch either by touching the screen at the new position or by using a light- 
pen to touch the screen. Shading depicts the extent of the changes to the system 
a change in the switch makes. 

After the student practices changing the switch to see the effects 
(either for a minimum amount of time or until ail switch settings have been tried), 
then the program offers an option to practice more or move on in the program, at 
the student's discretion. 
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NORM 

m 



L OFF ■ 




RUG 
PULL 

■R OFF 



OFF 

Continue to touch 
the other switch 
positions, noting 
the effect 
to the Primartj 
Regulating Valves- 



O 



Remember that 
AUGHENTATION PULL works 
onln from the NORHflL 
position on the Switch, flPU 




RIGHT 



NE 



ATS 



PRIHftRr 
PRESSURE 
REGULATING 
AND 

5HUT0FT 
VALVE 



Eil 

1 j 


"1 PRiriftRr 


», v. 


j PRESSURE 




REGULATING 




AND 




SHurorr 




VALVE 



EXT AIR 



LEFT ENGINE 
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Tutorial 



The short segment on the following few pages provides users of this 
handbook with a glimpse at a short tutorial. Naturally, this small segment is 
embedded in the larger context of fuel systems of the F-13 aircraft. This short 
tutorial concludes with an embedded question. The choice of what next to present 
to the student is based upon the answer given. In this segment both color and 
animation were used to depict the flow of fuel. The color names have been added 
to show the purpose of the animation. 
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Press BACK to review 



The following presentation 

will deal with motive flow principles 

used for transfer ing fuel 

inside the CF-1B aircraft. 

Some of the terms used mag be new 
or in need of clarification. 

o 

fin explanation of terms 
will be available to gou 
bg pressing HELP. 



Press HEKT to go on; C to comment on material. 

By permission of McDonnell Douglas Astronautics Company. 
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This screen offers an explanation of the effect of pressure on fuel flow. 
When viewed on a screen, the drde moves. The movement not only snows the 
actual course the fuel takes but the velocity change is also depicted. Note the 
"HELP available 1 * message at the top of the screen. Pressing HELP in this 
sequence, as noted on the previous screen, will lead to explanations of technical 
terms. Students also have the option of reviewing previous material by pressing 
BACK. 
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Help aval lafole 



Press BACK to review 




First, pressurized fuel 
flows through the venturi 
of an ejector. 

ft low pressure area is 
created from the fuel's 
velocity increase. 

The low pressure area, 
exposed to fuel in a 
tank, creates a suction 
which causes the fuel 
to be pumped (sucked) 
out of the tank and 
transferred elsewhere. 



Press NEXT to go on; C to comment on material. 

By permission of McDonnell Douglas Astronautics Company. 
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This screen has the same text, but there is an animated sequence going 
on in the graphic This animated sequence is repeated several times. Note that 
HELP and BACK are available. 
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Help available Press BACK to review 



O 

so 





Hotive flow fuel 
Transfer tank fuel 



First, pressurized fuel 
flows through the venturi 
of an ejector. 

fl low pressure area is 
created from the fuel's 
velocitjj increase. 

The low pressure area, 
exposed to fuel in a 
tank, creates a suction 
which causes the fuel 
to be pumped (sucked) 
out of the tank and 
transferred elsewhere. 

WfiTCH fiGAIH 



Press NEXT to go on; C to comment on material 

By permission of McDonnell Douglas Astronautics Company. 
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This screen presents an embeds question. It helps ensure that people 
do not simply skim through the material without learning It. 

This screen print shows the question, the answer we en^, end the 
feedback messace lor this answer. If the answer had been incorrect, the student 
t$cSEy wo^Wbeen branched to the beginning oi thesegment or perhaps to 
thTrernedal or review segment that follows on the next two pages. 
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Press BflCK to review 



PROGRESS CHECK 



The pressure decrease in the venturi provides 
a low pressure area. What does the low pressure 
area create? 



£ Enter tjour response (SO character limit) and press NEXT, 
suction 



You're right. 



By permission of McDonnell Douglas Astronautics Company. 
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This example of review uses the effective instructional technique of 
teaching by analogy, in this case teaching about motive flow operation with 
something more familiar So most studentst a garden hose sprayer. 
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REVIEW 




NEXT to go to neKt displatj 
BACK to go to previous displajj 
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Press F3 to end review 



The principles used 
to move fuel in the 
CF-18 are exact lg 
the same as those 
used in a common 
garden hose sprager. 



By permission of McDonnell Douglas 
Astronautics Company. 
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This screen uses color end animation to demonstrate the action. 

Note that the student is required to interact with the program in order 
to progress through the instructional sequence. 
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Press BflCK to review 



H 




Water pressure 
enters the sprajjer 
and is directed 
into a venturi. 



blue water 



R low pressure area 
is created at the 
bottom of the tube 
which sucKs the contents 
of the tank up 
and into the stream 
of pressurized water. 



Touch the graphic 

to see the final step. 



Press NEXT to go on; C to comment on material. 

By permission of McDonnell Douglas Astronautics Coopany. 
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Simulation 



Instructional simulations often involve animation and are usually used to 
depict complex interactions. Flight training is an obvious candidate for 
simulation because of the scarce and very expensive equipment required to 
provide pilots with the experience required to do their job. The following 
sequence exemplifies one of the very sophisticated flight simulators that emulate 
the cockpit environment. These provide procedural (but not cockpit environment) 
simulation for pilots. The next three prints show a small part of an instructional 
procedural simulation for pilots. This simulation sequence requires pilots to 
perform procedures exactly as they would in the cockpit by changing dials 
(touching the touch panel) and punching in coordinates and other data (touching 
keys on the screen's key pad). This instructional simulation has been found to 
have sufficient fidelity to the actual equipment that it aids in the economical 
preparation for operating the actual equipment. 
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You are in the cockpit of your airplane for Flight 
-45, on the ground at the gate. Perform the steps 
you feel necessary. The First Officer has entered the 
current time, the waypoints and position. 

Press the -RNS- key if you are having difficulties. 




for feedback 



to replot 



D R 


HOLD 


SVNC 


WARN 



POS 



OFF, 



WPT 



fODl S'CRS 
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JtrkI 

[CHC J 
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3r 
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4w 
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5 
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6e 

s — ^ 
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7 
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8s 
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9t 
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1~ ^ 

CLR 




HLD 
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By permission of the United Airlines Flight Training Center. 
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You are in the cockpit of your airplane for Flight 
45, on the ground at the gate. Perform the steps 
you feel necessary. The First Officer has entered the 
current time, the waypoints and position. 

Press the -RIMS- key if you are having difficulties. 



to review 



Uh . . • • - 



to rep lot 



nn ni 

uu U 1 




= R TO 


(ITT 
U 1 





TRK 
CHG 



D R 


HOLD 


SYNC 


WARN 



ft M I? 



OFF 





DTK/TK 



TEST 



R 



03 




* > 

3r 


t ' 

4w 


5 


6e 


7 


8s 

\ 4 


9t 


0 


f ' — h 

0 

S J 


0 


CLR 

> * 


HLD 


EHT 



By permission of the United Airlinee Flight Training Center, 
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Perform all the steps you feel necessary prior to 
departure. The current time is 16:42:00; the date is 
January 23rd. 



NOTRMS indicate that the Navy VLF station in Maryland 
will be subject to intermittent interruptions for the 
next 12 hours. Deselect this station. 



to review 




for feedback 



to replot 



DIM. 



nn nn n 
uu uu.u 


FR TC 










TEST 



By permission of the United Airlines Flight Training Center. 
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Inquiry 



The following sequence, provided by United Airlines, is an example of 
one kind of inquiry CAI in the form of review. There are more sophisticated 
examples of inquiry CAI available, but they are difficult to depict in paper 
format. This sequence shows one typical way that pilots can access the material 
they want: through a series of menus. Suppose a pilot has successfully completed 
flight training for the 767 aircraft. However, due to the natu— of the job, the 
pilot wishes to review materials and procedures for the aircraft using the United 
Airlines Flight Training Center. CAI, the pilot selects "b," Cockpit Preparation. 
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ll UNITED 767 COURSE |] 



♦ 


a. 


Introduction to PLATO/SPT 


♦ 


bT 


Cockpit Preparation - Captain 


♦ 


c- 


Evacuation/Cockpit Prep - F/0 


♦ 


d. 


Final Cockpit Preparation 


♦ 


e. 


Engine Start 


♦ 


f. 


After Start 




S* 


Taxi Out 




h. 


Takeoff 


♦ 


i . 


Rejected Takeoff 


♦ 


j - 


After Takeoff 




k. 


Climb 


♦ 


1. 


Cruise 


♦ 


m. 


Approach/Descent 


♦ 


n. 


Final Descent 


♦ 


o. 


Go-flround 


♦ 


P. 


Landing Roll 




q. 


Taxi -In 


♦ 


r. 


Parking 




3. 


Mi seel laneous 


♦ 


t. 


Computat i ons 


♦ 


U. 


Irregular Procedures 


♦ 


V. 


Emergency Pr oc. - FRM/FIM 


♦ 


w. 


F 1 i gbt Management System 



1 I PACK to Previous | SHIFT-STOP to leave I 

By permission ol the United Airlines Flight Training Center. 
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The user further refines his inquiry with this menu. In this instance, 
is selected. 
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♦ a/ Electrical System to BUS OFF LIGHTS 

♦ b. EXT. LIGHTS to BULK CARGO HEAT 

♦ c. n ight Management System to KYD. PATCL 

♦ d. ANTISKID SWITCH to FUEL HEAT SELECTORS 

♦ e. ENGINE START SELECT to EQUIP COOLING 

♦ f. INDICATOR LIGHTS toTETIP CONTROL SELECT 

♦ g. Autof light Panel to INSTRUMENT SOURCE 

♦ h. AIRSPEED BOICATOR to ALTIMETERS 

♦ i. VERTICAL SPEED IND. to THRUST REF- SET 

♦ j . EICAS DISPLAY to EEC SWITCHES 

♦ k. STAB. TRIM CUTOUT to RUDDER TRIM 

♦ 1. RCflRS System to SEAT AND RUDDER PEDALS 



I I BACK to Previous 1 SHIFT-STOP to leave 1 

By permission of the United Airlines Flight Training Center. 
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Deeper into the inquiry, the pilot must select specific information 
desired, or, in this case, must indicate where in the procedure the review is to 
start. In this case, T is selected. This inquiry can be stopped at any time. 

The next four pages are the instruction the pilot has requested. Note on 
each page the control the user has over the flow of the review (NEXT, BACK, 
INDEX, COMMENT); this control is a requirement of inquiry. 
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The ON light in the EXT PWR switch indicates the 
EPC has closed. 

This slide illustrates the electrical system powered 
by an external source. 



APU GEN EXT PWR 
BUS TIE 



L BUS 



•VftXL 



t — r 



BUS TIE 



WTl 



L 
GEN 
CONT 



UTILITY BUS 

L R RBUS 



GEN DRIVE DISC C£N 
L R CONT 



8 






F 










mn 





1 

f 




MOVE 


f 






ON LIGHT 



BRCKfREVIEUII DftTR-» INDEX lEDIT^XXiorfj 



By permission of the United Airlines Flight Training Center. 
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rhis slide shows the externa! power contactor (EPO 
>pen and external power available. When the external 
sower switch is pushed any other power source is 
removed, the EPC closes, and the main buses nre 
powered. 



TOUCH the EXT PUR switch to close the EPC. 



BUS TIE 



ftPU GEN EXT PWR 

BUS TIE 





UTILITY BUS 
L R 



L 
GEN 
CONT 




1 , 

r 
r 


4 




Hive 







GEN DRIVE DISC GEN 
L R C0NT 

1 1 




By permission oi the United Airlines Flight Training Center. 
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1 EXTERNAL POMER ftVfllL LIGHT CHECK cSTI 



The external p^wer switch is located on the electri 
panel. The AVAIL light in the lower half of the 
switch indicates external power is connected to the 
airplane and is of usable voltage and frequency. 



EXTERNAL POWER SWITCH 



ftPU GEN \EXT PWR 
BUS TIE 



AUTO 



L BUS 













DVtXL 



EZE 



BUS TIE 



UTILITY BUS 
L R 



UTI 



L 
GEN 
CONT 



RBUS 



GEN DRIVE DISC GEN 
L R CONT 



1 


& 




f 






r 




•Off 




KXff 


i 

t 
f 




I 









BflCK-+R£VIEU<| PftTB-» INDEX EDIT-»Cm€NTl 



By permission of the United Airlines Flight Training Center. 
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Cockpit Preparation - Captain 
Electrical System thru PUS OFF LIGHTS 



You have completed this material, so you may review 
any part of it by typing its letter, or you may 
return to the lesson index by pressing NEXT or BACK. 



♦ 
♦ 
♦ 
♦ 
♦ 
♦ 
♦ 
♦ 
♦ 

♦ 
♦ 
♦ 
♦ 



a. 

b. 
c. 
d. 
e. 
f. 

g. 

h. 
i . 

j • 

k. 

« 

i . 
m. 
n. 
o. 



Electrical System Description 

BATTERY SWITCH ON 

STANDBY POWER SELECTOR AUTO 

Hydraulic System Description 

HYDRAULIC PANE1 SET 

API) System Description 

APU START 

APU GENERATOR SWITCH VERIFY ON 

EXTERNAL POWER AVAIL LIGHT CHECK ON 

EXTERNAL POWER SWITCH ON 

Electrical Panel Set 

BUS TIE SWITCHES VERIFY AUTO 

UTILITY BUS SWITCHES VERIFY ON 

L, R, AND UTIL BUS OFF LIGHTS OFF 

Knowledge Test 
Procedures Review/Test 



i T \ H' 



BACK to Lesson index SHIFT-STOP to leave 



By permission of the United Airlines Flight Training Center. 
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This is the last display the pilot-user wishes to review. After completing 
the review presented here, the pilot presses the DATA key on the keyboard and is 
returned to the lag index encountered. 
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Once the EPC is closed it remains closed unless: 

♦ The external power switch is pushed. 

♦ Both engine generator breakers are closed. 

♦ External oower becomes unavailable or is 
d i ©connected . 

♦ External power overload occurs. 

♦ fl fault on the tie bus occurs. 



RPL1 GEN EXT PUR 



BUS TIE 




n 


BUS TIE 




19111 


MTS 












UTILITY BUS 
L R 




L BUS 


RBUS 






i — _ • 

- 






L 
GEN 
CONT 






R 

: GEN 
CONT 




gen dr: 

L 


[VE 


: disc 

R 


1 • t 




1 




if 


wm 


nm 



MIMMMIfl j jl^ drtfk index {EDiT^caresm 



By permission of the United Airlines Flight Training Center. 
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After retiming to the deepest Index encountered before instruction, the 
pilot may choose to take a test (n and o of menu options) as part of the inquiry. In 
this sequence the pilot has selected -n.« Note that in the following two question, 
answer examples, feedback is provided. 
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BAT STBY POWER 




p 



The airplane is undowered except that the battery 
switch is ®. Are the panel indications shown 
here correct? 



EH9 



1. Yes, the battery bus loads are not 
sufficient to cause the DISCH light 
to come on. 

2. The standby power OFF light is not 
powered until the selector is in 
AUTO or DAT. 

3. No. 



DATA -* INDEX 



By permission ei the United Airlines Flight Training Center. 
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The airplane is unpowered except that the battery 
switch is @). Are the panel indications shown 
here correct? 



1 . 



Yes, the battery bus loads are not 
sufficient to cause the DISCH light 
to come on. 



2. The standby power OFF light is not 
powered until the selector is in 
AUTO or BAT. 



No. 



Touch o r typ e your answer. 



3 



By permission of the United Airlines Fiight Training Center. 
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Assume no airplane generators or external power 
are available on the airplane. What buses are 
powered if the battery switch is off? 

1. Hot battery bus only. 

2. Hot battery and standby DC buses. 

3. Hot battery and all stanctey buses. 




j| DAT ft -> INDEX 



LflB feEVIEU? 



By permiiiion oi the United Airlines Flight Training Center. 
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Assume no airplane generators or external power 
are available on the airplane. What buses are 
powered if the battery switch is off? 

1 . Hot battery bus only. 

2. Hot battery and standby DC buses. 

3. Hot battery and all standby buses. 



Touch o r typ e your answer. 



By permission of the United Airlines Flight Training Center. 
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Cockpit Preparation - Captain 
Electrical System thru BUS OFF LIGHTS 



You have completed this material, so you may review 
any part of it by typing its letter, or you may 
return to the lesson index by pressing NEXT or BACK. 



♦ 
♦ 
♦ 
♦ 
♦ 
♦ 

♦ 
♦ 
♦ 

♦ 
♦ 
♦ 

♦ 



a. 

b. 
c. 
d. 
e. 
f. 

£• 

h. 

j • 

k. 
1. 

m. 
n. 
c 



Electrical System Description 

BATTERY SWITCH ---ON 

STANDBY POWER SELECTOR AUTO 

Hydraulic System Description 

HYDRAULIC PANEL SET 

FPU System Description 

ftPU START 

APU GENERATOR SWITCH VERIFY ON 

EXTERNAL POWER AVAIL LIGHT . .CHECK ON 

EXTERNAL POWER SWITCH ON 

Electrical Panel Set 

BUS TIE SWITCHES VERIFY AUTO 

UTILITY BUS SWITCHES VERIFY ON 

L, R, AND UTIL BUS OFF LIGHTS OFF 

Knowledge Test 
Procedures Review/Test 



BftCK to Lesson index 1 SHIFT -STOP to leave 1 



By permission of the United Airlines Flight Training Center. 
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E. Selected CAjNReUted Civilian 
Associations and Periodicals 



CAl-Related Civilian Associations 

American Educational Research Association (AERA) 
1126 16th Street, N.W. 
Washington, DC 20036 
Phone: (202) 223-9*85 



Founded: 1915 



Professional organization of educators and behavioral scientists 
interested in the development, application and improvement of 
educational research. Members include professors, state and local school 
system research directors, research specialists, graduate students of 
education and educators in foreign countries. 

Publications: 



1. Educational Researcher, monthly 

2. Educational Evaluation and Policy Analysis, bimonthly 

3. American Educational Research Journal, quarterly 

4. Journal of Educational Statistics, quarterly 

5. Review of Educational Research, quarterly 

6. Review of Research in Education, annual? Sponsors Encyclopedia of 
Educational Research (revised every 10 years); Handbook of 
Research on Teaching (revised every 10 years). 

Formerly: (1930) National Association of Directors of Educational 
Research 

Convention/ Meeting: annual 



Association for Development of Computer-Based Instructional Systems (ADCIS) 
Computer Center 3 
Western Washington State College 
Beilingham, WA 98225 
Phone: (206) 676-2860 



Founded: 1968 



University, junior college, high school, military and commercial users of 
computer-assisted and/or -managed instruction. Purposes are to advance 
the investigation and utilization of computer-assisted instruction 
systemsj promote the interchange of information, programs, and 
materials in the best professional and scientific tradition; reduce 
redundant effort among system users; specify requirements and their 
priorities for hardware and software development, and encourage and 
facilitate their accomplishment through cooperative projects. 
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Presents awards. Special Interest Group* Computer-Based Train ingj 
Education of the Deaf; Elementary/Sccondary/3unior College; Health; 
Implementation! Minicomputer Users; Music Consortium* Plato Users* 

Publications! 

1. Newsletter, bimonthly 

2. Journal of Computer Based Instruction, quarterly 

Formerly* (1973) Association for Development of Instructional Systems 
Convention/ Meeting: annual 

Association for Educational Communications and Technology (AECT) 
1126 16th Street, N.W. 
Washington, DC 20036 
Phones (202) S3 3-4 130 

Founded! 1923 

Audiovisual and instructional materials specialists, educational 
technologists, audiovisual and television production personnel and 
teacher educators. To improve education through the systematic 
planning, application and production of communications media for 
instruction. Maintains archives of materials and equipment. 

Publications! 

1. Newsletter, monthly 

2. Audiovisual Instruction, 9/year 

3. Educational, Communications and Technology Research Journal, 
quarterly 

4. Journal of Instructional Development, quarterly 

5. Membership Data Book, annual 

Formerly: (1932) National Academy of Visual Instruction 
(1947) Department of Visual Instruction 
(1970) Department of Audiovisual Instruction 

Association for Educational Data Systems (AEDS) 
1201 16th Street, N.W. 
Washington, DC 20036 
Phone: (202)833-4100 

Founded: 1962 

Persons involved directly with planning, development *nd operation of 
educational data processing systems and the transmission of optional 
information in machine usable form. Seeks to "promote * ££ter I low 
of information among educators and educational administrators 
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ZTlfpuJZwT* in,0fm * tion techniques, materials 

Publications] 

1. Bulletin, quarterly 

2. Journal, quarterly 

3. Monitor, quarterly 

Handbook and Directory, irregular 

«ru p ^ e, c5* mputer c,ub handbook - convention 

Affiliated withj American Federation of Information Processing 
Societies Institute for Certification of Computer Professionals 

Le^ntTg* ° ,7,) N * tl0nal AsS0da,i0n of Use " 01 Computer Applied 



M^Miriu " ,d In,tnJC, ' 0n (Pro ^ mn ' ed In,,ruc, M) <nspo 



Washington, DC 20036 
Phone: (202)833-4178 

Founded: 1962 



Wl i MacWevin « e "^tlve performance analysis and 
J!SSr^ i &^ pm-nt and ^•nwnt.ttan.- Members also 
sv^l -nw * t *° f mana * ement and management information 
J?'^ of support systems and motivation systems when developing 

^f,^ *~ M *<^ * bureau? 



Publications: 



1. Journal, 10/year 

2. Improving Human Performance, quarterly 

3. Official International Directory of Members, biennial 

Formerly: (1973) National Society for Programmed Instruction 
Convention/Meeting Annual 



Society for Applied Learning technology (SALT) 
50 Cuipeper Street 
Warrenton, VA 22186 
Phone: (703) 3*7-0055 

Founded: 1972 
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Senior executives from military, academic and industrial organs ions 
which desist, manufacture or use training technology, including 
c^%te7iS^ instruction, simulator., trainers, fg^S 
instruction delivery devices and Job perlormance aids. SALT founders 
and officers report that their obectives are to support, improve, 
advance Tand geiiraUy contribute to the development of standards and 
practices in the application of technology to training and to aid and 
assist individuals, agencies and institutions with respect to the 
a^ication of tracing technology to the definition and solution of social 
and human problems! to facilitate the exchange •« ^J*"** 
experience with respect to the current state-of-the-art with respect 
to known ongoing efforts directed toward the advancement of the use of 
training technology; to foster wide dissemination of ^rstonding and 
knowledge in the actual and potential use of technology In tte field of 
training in order to assure and realize the maximum contribution > of tWs 
technotogy to the nation and the world; to provide an effective 
educational channel among and between scientists, managers and users 
of training technology both in the private and public sectors in the U.S. 
with the object of assuring adequate skills, understanding and effective 
management of training technology. Bestows awards for °| 
outstanding contributions. Conducts seminars. Maintains special 
interest groups. 

Publications: 

Journal of Educational Technology Systems, quarterly 
Also publishes Conference Proceedings. 

Convention/ Meeting: semiannual 

Also sponsors International Learning Technology Congress and Exposition 

biennially. 

These descriptions taken from Yakes, N., & Akey, D. (Eds.). Encyclopedia of 
Associations (Vol. 1). Detroit, MI: Gale Research Co., 1980. 
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CAI-Rclated Civilian Periodic « 



ACQS Journal 

1201 Sixteenth Street, N.W. 
Washington, DC 20036 

Computers and Education 
Pergamon Press Ltd. 
Headington Hill Hall 
Oxford OX3 OBW, England 

Creative Computing Magazine 

P.O. Box 7«9-M ^ 

Morristown, NJ 07960 

Educational Communication and 

Technolo£v Journal 
Association for Educational 

Communications and Technology 
1126 16th Street, N.W. 
Washington, DC 20036 

Educational Technolog y 
1 40 Sylvan Avenue 
Englewood Cliffs, NJ 07632 

Info World 

530 Lytton Avenue 

Palo Alto, CA 94301 

Journal of Computer-Based 

Instruction 
215 South Main 
Clarion, IA 50525 

Journal of Educational 
Technology Systems' " 
Baywood Publishing Co., Inc. 
120 Marine Street 
Farmingdale, NY 11737 

Journal of Instructional 

Development 
Association for Educational 

Communications and Technology 
1126 16th Street, N.W, 
Washington, DC 20036 
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CAI-Relatcd Civilian Periodicals 



AEDS Journal 

1201 Sixteenth Street, N.W. 
Washington, DC 20036 

Computers and Education 
Per gamon Press Ltd. 
Headington Hill Hall 
Oxford 0X3 OBW, England 

Creative Computing Magazine 
P.O. feox 7S9-M 
Morristown, NJ 07960 

Educational Communication and 

Technology Journal 
Association for Educational 

Communications and Technology 
1126 16th Street, N.W* 
Washington, DC 20036 

E ducational Technology 
~ t > Sylvan Avenue 
'n^ewood Cliffs, NJ 07632 

Info World 

530 Lytton Avenue 

Palo Alto, CA 9*301 

Journal of Com outer-Based 

Instruction 
215 South Main 
Clarion, 1A 50325 

Journal of Educational 
Technology Systems 
Bay wood Publishing Co., Inc. 
120 Marine Street 
Farmingdale, NY 11737 

Journal of Instructional 

Development 
Association for Educational 

Communications and Technology 
1126 16th Street, N.W. 
Washington, DC 20036 



ufc focomouterNtws 
Benwlfl Publishing Corp. 
1030 Commonwealth Avenue 
Boston, MA 02215 

Mini-Micro Systems 
270 St. Paul Street 
Denver, CO 30206 

Performance and Instruction 
National Society for Performance 
and Instruction 
1126 16th Street, N.W. 
Suite 315 

Washington, DC 20036 

Review of Educational Research 
"American Educational Research 
Association 
1230 17th Street, N.W. 
Washington, DC 20036 

T.H.E. Journa l 
Synergy, inc. 
P.O. Box 992 
Action, MA 01720 



iftlt 8«» 1MI7 

242 



261 



